Apr 20 15:56:23 user devstack@n-api.service[61516]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 15:56:23 user devstack@n-api.service[61516]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 20 15:56:23 2023] *** Apr 20 15:56:23 user devstack@n-api.service[61516]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 20 15:56:23 user devstack@n-api.service[61516]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 20 15:56:23 user devstack@n-api.service[61516]: nodename: user Apr 20 15:56:23 user devstack@n-api.service[61516]: machine: x86_64 Apr 20 15:56:23 user devstack@n-api.service[61516]: clock source: unix Apr 20 15:56:23 user devstack@n-api.service[61516]: pcre jit disabled Apr 20 15:56:23 user devstack@n-api.service[61516]: detected number of CPU cores: 12 Apr 20 15:56:23 user devstack@n-api.service[61516]: current working directory: / Apr 20 15:56:23 user devstack@n-api.service[61516]: detected binary path: /usr/bin/uwsgi-core Apr 20 15:56:23 user devstack@n-api.service[61516]: your processes number limit is 63637 Apr 20 15:56:23 user devstack@n-api.service[61516]: your memory page size is 4096 bytes Apr 20 15:56:23 user devstack@n-api.service[61516]: detected max file descriptor number: 2048 Apr 20 15:56:23 user devstack@n-api.service[61516]: lock engine: pthread robust mutexes Apr 20 15:56:23 user devstack@n-api.service[61516]: thunder lock: enabled Apr 20 15:56:23 user devstack@n-api.service[61516]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 15:56:23 user devstack@n-api.service[61516]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 20 15:56:23 user devstack@n-api.service[61516]: Python main interpreter initialized at 0x563d913a5990 Apr 20 15:56:23 user devstack@n-api.service[61516]: python threads support enabled Apr 20 15:56:23 user devstack@n-api.service[61516]: your server socket listen backlog is limited to 100 connections Apr 20 15:56:23 user devstack@n-api.service[61516]: your mercy for graceful operations on workers is 90 seconds Apr 20 15:56:23 user devstack@n-api.service[61516]: mapped 537436 bytes (524 KB) for 3 cores Apr 20 15:56:23 user devstack@n-api.service[61516]: *** Operational MODE: preforking *** Apr 20 15:56:23 user devstack@n-api.service[61516]: *** uWSGI is running in multiple interpreter mode *** Apr 20 15:56:23 user devstack@n-api.service[61516]: spawned uWSGI master process (pid: 61516) Apr 20 15:56:23 user devstack@n-api.service[61516]: spawned uWSGI worker 1 (pid: 61517, cores: 1) Apr 20 15:56:23 user devstack@n-api.service[61516]: spawned uWSGI worker 2 (pid: 61518, cores: 1) Apr 20 15:56:23 user devstack@n-api.service[61516]: spawned uWSGI worker 3 (pid: 61519, cores: 1) Apr 20 15:56:23 user devstack@n-api.service[61516]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 15:56:23 user devstack@n-api.service[61517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 15:56:23 user devstack@n-api.service[61519]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 15:56:23 user devstack@n-api.service[61518]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 15:56:27 user devstack@n-api.service[61518]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 15:56:27 user devstack@n-api.service[61518]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 15:56:27 user devstack@n-api.service[61518]: and ``live_migration_inbound_addr`` respectively. Apr 20 15:56:27 user devstack@n-api.service[61518]: ). Its value may be silently ignored in the future. Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 15:56:27 user devstack@n-api.service[61517]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 15:56:27 user devstack@n-api.service[61517]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 15:56:27 user devstack@n-api.service[61517]: and ``live_migration_inbound_addr`` respectively. Apr 20 15:56:27 user devstack@n-api.service[61517]: ). Its value may be silently ignored in the future. Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 15:56:27 user devstack@n-api.service[61519]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 15:56:27 user devstack@n-api.service[61519]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 15:56:27 user devstack@n-api.service[61519]: and ``live_migration_inbound_addr`` respectively. Apr 20 15:56:27 user devstack@n-api.service[61519]: ). Its value may be silently ignored in the future. Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61517) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61518) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: INFO dbcounter [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Registered counter for database nova_api Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_db.sqlalchemy.engines [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61517) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61519) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writer thread running {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61518]: INFO dbcounter [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Registered counter for database nova_api Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61518) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writer thread running {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG nova.context [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c920c466-c336-4d65-b6e3-87fa61d5f331(cell1) {{(pid=61517) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:56:27 user devstack@n-api.service[61517]: INFO dbcounter [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Registered counter for database nova_cell0 Apr 20 15:56:27 user devstack@n-api.service[61517]: INFO dbcounter [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Registered counter for database nova_cell1 Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_db.sqlalchemy.engines [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61517) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_db.sqlalchemy.engines [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61517) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writer thread running {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writer thread running {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG nova.context [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c920c466-c336-4d65-b6e3-87fa61d5f331(cell1) {{(pid=61518) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:56:27 user devstack@n-api.service[61519]: INFO dbcounter [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Registered counter for database nova_api Apr 20 15:56:27 user devstack@n-api.service[61518]: INFO dbcounter [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Registered counter for database nova_cell0 Apr 20 15:56:27 user devstack@n-api.service[61518]: INFO dbcounter [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Registered counter for database nova_cell1 Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61518) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writer thread running {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_db.sqlalchemy.engines [None req-85492952-7621-4b37-ad6f-810540b9945f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61519) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writer thread running {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG nova.context [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c920c466-c336-4d65-b6e3-87fa61d5f331(cell1) {{(pid=61519) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:56:27 user devstack@n-api.service[61519]: INFO dbcounter [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Registered counter for database nova_cell0 Apr 20 15:56:27 user devstack@n-api.service[61519]: INFO dbcounter [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Registered counter for database nova_cell1 Apr 20 15:56:27 user devstack@n-api.service[61517]: INFO dbcounter [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Registered counter for database nova_cell0 Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_db.sqlalchemy.engines [None req-85492952-7621-4b37-ad6f-810540b9945f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61519) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writer thread running {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_db.sqlalchemy.engines [None req-85492952-7621-4b37-ad6f-810540b9945f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61519) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG oslo_db.sqlalchemy.engines [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61517) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writer thread running {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61518) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writer thread running {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61518]: INFO dbcounter [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Registered counter for database nova_cell0 Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG oslo_db.sqlalchemy.engines [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61518) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writer thread running {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writer thread running {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:27 user devstack@n-api.service[61519]: INFO dbcounter [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Registered counter for database nova_cell0 Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG oslo_db.sqlalchemy.engines [None req-85492952-7621-4b37-ad6f-810540b9945f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61519) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 15:56:27 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writer thread running {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 15:56:28 user devstack@n-api.service[61517]: WARNING keystonemiddleware.auth_token [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:56:28 user devstack@n-api.service[61517]: WARNING keystonemiddleware.auth_token [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:56:28 user devstack@n-api.service[61518]: WARNING keystonemiddleware.auth_token [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:56:28 user devstack@n-api.service[61518]: WARNING keystonemiddleware.auth_token [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:56:28 user devstack@n-api.service[61517]: WARNING keystonemiddleware.auth_token [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:56:28 user devstack@n-api.service[61517]: WARNING keystonemiddleware.auth_token [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:56:28 user devstack@n-api.service[61518]: WARNING keystonemiddleware.auth_token [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:56:28 user devstack@n-api.service[61517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563d913a5990 pid: 61517 (default app) Apr 20 15:56:28 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:56:28 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001646 Apr 20 15:56:28 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 20 15:56:28 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:56:28 user devstack@n-api.service[61518]: WARNING keystonemiddleware.auth_token [None req-fa2d83a1-6123-4a92-8d06-25095b54120b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:56:28 user devstack@n-api.service[61518]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563d913a5990 pid: 61518 (default app) Apr 20 15:56:28 user devstack@n-api.service[61519]: WARNING keystonemiddleware.auth_token [None req-85492952-7621-4b37-ad6f-810540b9945f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:56:28 user devstack@n-api.service[61519]: WARNING keystonemiddleware.auth_token [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:56:28 user devstack@n-api.service[61519]: WARNING keystonemiddleware.auth_token [None req-85492952-7621-4b37-ad6f-810540b9945f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 15:56:28 user devstack@n-api.service[61519]: WARNING keystonemiddleware.auth_token [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 15:56:28 user devstack@n-api.service[61519]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563d913a5990 pid: 61519 (default app) Apr 20 15:58:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:37 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-c276f4da-c1f7-40c0-b3c1-07dba62548b0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001504 Apr 20 15:58:37 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:37 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:37 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=3 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:37 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=3 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:37 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=3 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:37 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=3 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:38 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-665e40eb-05f0-4150-b7cb-7c7db3447ab7 admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:38 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-665e40eb-05f0-4150-b7cb-7c7db3447ab7 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.459182 Apr 20 15:58:38 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 15:58:37 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:40 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:40 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-85492952-7621-4b37-ad6f-810540b9945f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003201 Apr 20 15:58:40 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:40 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:40 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:40 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:40 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:40 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:40 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-a6790ce3-5bbd-4453-8059-2c1b4b97a55c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:40 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-a6790ce3-5bbd-4453-8059-2c1b4b97a55c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.346406 Apr 20 15:58:40 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:40 2023] POST /compute/v2.1/flavors => generated 405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:40 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-5de07f6d-2ae2-4dd7-a891-225c35d6d04f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:40 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-5de07f6d-2ae2-4dd7-a891-225c35d6d04f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054683 Apr 20 15:58:40 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:58:40 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:42 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:42 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-85492952-7621-4b37-ad6f-810540b9945f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001408 Apr 20 15:58:42 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:42 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-3c36f482-54a7-46c5-a643-805e653d2ff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-3c36f482-54a7-46c5-a643-805e653d2ff0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072859 Apr 20 15:58:42 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:42 2023] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:42 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-1fd40e68-12f6-4d2b-851a-c721dd20cf33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:42 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-1fd40e68-12f6-4d2b-851a-c721dd20cf33 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028280 Apr 20 15:58:42 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:58:42 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:44 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:44 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-85492952-7621-4b37-ad6f-810540b9945f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002692 Apr 20 15:58:44 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:44 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:44 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-f59198e0-f272-4d64-9091-7a005a9a269e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "name": "ds1G", "ram": 1024, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-f59198e0-f272-4d64-9091-7a005a9a269e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063302 Apr 20 15:58:44 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:44 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f693a6dd-d19e-45d5-bd1b-eb74ebb066d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:44 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-f693a6dd-d19e-45d5-bd1b-eb74ebb066d6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025504 Apr 20 15:58:44 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:58:44 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:46 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:46 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-85492952-7621-4b37-ad6f-810540b9945f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001980 Apr 20 15:58:46 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:46 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-da73f043-13c8-41c5-a11a-3915923ece6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:46 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-da73f043-13c8-41c5-a11a-3915923ece6b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067796 Apr 20 15:58:46 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:46 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-b9bc0917-d907-4320-87ca-097df4ed1bee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:46 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-b9bc0917-d907-4320-87ca-097df4ed1bee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028306 Apr 20 15:58:46 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:58:46 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:48 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:48 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-85492952-7621-4b37-ad6f-810540b9945f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001544 Apr 20 15:58:48 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:48 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-522243e0-f58d-45ec-85a8-ab94c3e5b65d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "swap": 0}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:48 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-522243e0-f58d-45ec-85a8-ab94c3e5b65d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059103 Apr 20 15:58:48 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:48 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:48 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:48 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025825 Apr 20 15:58:48 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 15:58:48 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:50 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-85492952-7621-4b37-ad6f-810540b9945f None None] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:50 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-85492952-7621-4b37-ad6f-810540b9945f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001904 Apr 20 15:58:50 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:50 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-824e04fc-0250-4e6e-8a05-9d27b68864b9 admin admin] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:50 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-824e04fc-0250-4e6e-8a05-9d27b68864b9 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.090351 Apr 20 15:58:50 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 15:58:50 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 15:58:52 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:52 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002071 Apr 20 15:58:52 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:52 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:52 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:52 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:52 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:58:52 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-7c714c42-acb9-4522-bc43-0b455df458c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "id": "1"}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:52 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-7c714c42-acb9-4522-bc43-0b455df458c9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.314506 Apr 20 15:58:52 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:52 2023] POST /compute/v2.1/flavors => generated 400 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:53 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-b00f4c82-a7b5-4c7b-99e9-85886222cccd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:53 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-b00f4c82-a7b5-4c7b-99e9-85886222cccd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037957 Apr 20 15:58:53 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:58:53 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:54 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:54 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001431 Apr 20 15:58:54 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:54 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-c0493d76-1022-48c1-9d90-4acb552c1902 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:54 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-c0493d76-1022-48c1-9d90-4acb552c1902 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.058940 Apr 20 15:58:54 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:54 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 15:58:54 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-1e6ff7ee-3055-4718-a57d-efe71b3f2222 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:55 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-1e6ff7ee-3055-4718-a57d-efe71b3f2222 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033401 Apr 20 15:58:55 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:58:54 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:56 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:56 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001436 Apr 20 15:58:56 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:56 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-7e4c18f3-3835-4901-80da-e5b23e420a91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "swap": 0, "disk": 40}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:57 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-7e4c18f3-3835-4901-80da-e5b23e420a91 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.058616 Apr 20 15:58:57 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:56 2023] POST /compute/v2.1/flavors => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:57 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-881313ca-f9b3-4733-8949-78cffb4eaf12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:57 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-881313ca-f9b3-4733-8949-78cffb4eaf12 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024578 Apr 20 15:58:57 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:58:57 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:58:58 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:58:58 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002218 Apr 20 15:58:58 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:58:58 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:58:58 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-2903d14f-9c36-4d8f-8ee5-74739c33dd77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "disk": 80, "ram": 8192, "vcpus": 4}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:59 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-2903d14f-9c36-4d8f-8ee5-74739c33dd77 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062092 Apr 20 15:58:59 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:58:58 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:58:59 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ec11ad07-fe5b-4ff8-b77e-630653c8ee93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:58:59 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ec11ad07-fe5b-4ff8-b77e-630653c8ee93 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024832 Apr 20 15:58:59 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:58:59 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:59:00 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:59:00 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001516 Apr 20 15:59:00 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 15:59:00 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:59:00 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-eaa0b837-d342-4aad-aeac-2b2eb7448f1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "disk": 160}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:59:00 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-eaa0b837-d342-4aad-aeac-2b2eb7448f1c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.061749 Apr 20 15:59:00 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 15:59:00 2023] POST /compute/v2.1/flavors => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 15:59:00 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-25798ad5-4c17-4c5b-9809-f184bcc23251 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 15:59:01 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-25798ad5-4c17-4c5b-9809-f184bcc23251 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023247 Apr 20 15:59:01 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 15:59:00 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 15:59:32 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:59:32 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e2efa887-b8d5-4654-a3aa-08acdac30eaf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001613 Apr 20 15:59:32 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 15:59:32 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 15:59:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 15:59:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.097841 Apr 20 15:59:32 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 20 15:59:32 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 16:00:04 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-25798ad5-4c17-4c5b-9809-f184bcc23251 admin admin] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:00:04 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-25798ad5-4c17-4c5b-9809-f184bcc23251 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001757 Apr 20 16:00:04 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 16:00:04 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:00:04 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:00:04 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-6578dbe4-c319-43ce-9c63-9da7d8cfadcf admin admin] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:00:04 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-6578dbe4-c319-43ce-9c63-9da7d8cfadcf admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.064215 Apr 20 16:00:04 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 20 16:00:04 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:00:08 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:00:08 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002553 Apr 20 16:00:08 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 16:00:08 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:00:08 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:00:08 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-d84ea4dc-789e-47cc-8255-609ff80e38e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "id": "42", "vcpus": 1, "swap": 0, "disk": 1, "ram": 128, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:00:08 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-d84ea4dc-789e-47cc-8255-609ff80e38e6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068906 Apr 20 16:00:08 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 16:00:08 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 16:00:08 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-232bc5af-34ac-4e78-980d-a3e26b18ad66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:00:08 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-232bc5af-34ac-4e78-980d-a3e26b18ad66 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025016 Apr 20 16:00:08 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 16:00:08 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:00:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:00:12 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-6599f5b3-4992-4db7-97e1-34086fb28dba admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002206 Apr 20 16:00:12 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 16:00:12 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:00:12 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-cb8d007c-8fb5-46c5-8380-c82dc2fee4f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro", "ram": 192, "vcpus": 1, "rxtx_factor": 1.0, "id": "84", "swap": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:00:12 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-cb8d007c-8fb5-46c5-8380-c82dc2fee4f1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074153 Apr 20 16:00:12 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 16:00:12 2023] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 16:00:13 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-cbc18133-bb5a-4965-9cc8-5f2f022c4bc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:00:13 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-cbc18133-bb5a-4965-9cc8-5f2f022c4bc8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024147 Apr 20 16:00:13 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 16:00:13 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:02:41 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:02:41 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:02:41 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:02:41 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-9b6e9245-7146-427a-8322-959a0130ceed tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Action: 'create', calling method: .version_select at 0x7f5588562b90>, body: {"keypair": {"name": "tempest-keypair-1817335126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFt/ltdSvvBHQ2MsuXJOTGRFwD86myzO9h0omThgGXoNYZmwXr9cWEFLEKbGl6QHLxLCdivOfggvbdx8hlLQgYsXTya/bJWP27fOABo2+ny5YKslC9RhYnn4AafsHJgFg=="}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:41 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-9b6e9245-7146-427a-8322-959a0130ceed tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for project 71cf2664111f45788d24092e8ceede9c. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:41 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-9b6e9245-7146-427a-8322-959a0130ceed tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for user 690c49feae904687826fb959ba5ba283 and project 71cf2664111f45788d24092e8ceede9c. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-9b6e9245-7146-427a-8322-959a0130ceed tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205593 Apr 20 16:02:41 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:02:41 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:02:44 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:02:44 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-722f51b7-122f-49a2-819c-e36ea7975f36 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Action: 'create', calling method: .version_select at 0x7f558854e950>, body: {"keypair": {"name": "tempest-keypair-58929071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZym0vodVYP/JGy/H71EPtkiLL3pgSyqc+6Le0y9dituQzc/wfdGdwVdf4pgjAAE55MUTGyqTl0C2t2y934ULtfkrcvhTphaGXzfELzex4GVcPZlULQOFRqsadQFb89Hw=="}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:44 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-722f51b7-122f-49a2-819c-e36ea7975f36 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Getting quotas for project fbbcfeb5266f4ca6b9738b18ba7d127e. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:44 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-722f51b7-122f-49a2-819c-e36ea7975f36 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Getting quotas for user 48eeb9edc18f48f0ad13c819cdac9106 and project fbbcfeb5266f4ca6b9738b18ba7d127e. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-722f51b7-122f-49a2-819c-e36ea7975f36 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.213623 Apr 20 16:02:44 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:02:44 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:02:47 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:02:47 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-69ec3b41-9ab1-4124-9cd3-24dcc0e23c44 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Action: 'create', calling method: .version_select at 0x7f558853a680>, body: {"keypair": {"name": "tempest-keypair-1173247378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkHFFsWtozUTkF0VpQ+Cd6z15wOd291X4e8/v6QbZKdTx6+gptvNMQSpe0ybBenimgtpgGav2HnMz19ylSDLLeiOEgxywkrcPA8Jq0CjCrxBO54bQ0ViTd2ITYv71kQ9Q=="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:47 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-69ec3b41-9ab1-4124-9cd3-24dcc0e23c44 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:47 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-69ec3b41-9ab1-4124-9cd3-24dcc0e23c44 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for user f50dbce30f294bb0ba6bc2811025835d and project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:47 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-69ec3b41-9ab1-4124-9cd3-24dcc0e23c44 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.390340 Apr 20 16:02:47 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 16/48] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 16:02:47 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 392 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 16:02:48 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-808094645", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "892f26a6-0815-41df-a910-d2e69e162820"}]}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:48 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1335393395", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "c36830a6-66f7-4f28-8879-e228da46cead"}]}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:48 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] validate_networks() for [('892f26a6-0815-41df-a910-d2e69e162820', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:02:48 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-112425079", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2dc9b3da-0124-4718-9f70-a131cd030480"}], "security_groups": [{"name": "tempest-securitygroup--1650603645"}], "key_name": "tempest-keypair-1817335126", "user_data": "}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:48 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] validate_networks() for [('c36830a6-66f7-4f28-8879-e228da46cead', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:02:48 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] validate_networks() for [('2dc9b3da-0124-4718-9f70-a131cd030480', None, None, None, None, None)] {{(pid=61518) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Flavor limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Image limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Flavor pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Image pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for project 71cf2664111f45788d24092e8ceede9c. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for user 690c49feae904687826fb959ba5ba283 and project 71cf2664111f45788d24092e8ceede9c. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Going to run 1 instances... {{(pid=61518) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:02:50 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-5157c134-78bd-4aef-8c9e-48c14bf85791 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.071305 Apr 20 16:02:50 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 17/49] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:02:48 2023] POST /compute/v2.1/servers => generated 400 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-942605486", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "224391e3-9d6f-4e5f-b1bb-00dd1cd0ea06"}], "security_groups": [{"name": "tempest-securitygroup--412466437"}], "key_name": "tempest-keypair-58929071", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:50 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] validate_networks() for [('224391e3-9d6f-4e5f-b1bb-00dd1cd0ea06', None, None, None, None, None)] {{(pid=61518) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Getting quotas for project 3336309776d848efaf237863a5b9bfeb. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Getting quotas for user 8a7606e886554ff7948a4e246dd98677 and project 3336309776d848efaf237863a5b9bfeb. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Getting quotas for project d8444d3c8f554a56967917670b19dc37. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Getting quotas for user 9be25e958c6047068ab5ce63106b0754 and project d8444d3c8f554a56967917670b19dc37. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] [instance: 6d55e5bd-9b03-40a9-bca9-88545039597c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:02:51 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-b5e7ee3c-4e99-4c4a-8ef1-6559580f48e6 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.556083 Apr 20 16:02:51 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 16/50] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:02:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 3558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-2bc4b2bb-393f-4ec3-96f7-d01af26e503f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-2bc4b2bb-393f-4ec3-96f7-d01af26e503f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:02:51 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-013f893b-bbaf-49f0-8539-c25b22e45b60 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.310423 Apr 20 16:02:51 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 18/51] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:02:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 3312 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-efd2e634-f4a3-4713-b7fb-878719a86e93 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-efd2e634-f4a3-4713-b7fb-878719a86e93 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] [instance: 6d55e5bd-9b03-40a9-bca9-88545039597c] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-efd2e634-f4a3-4713-b7fb-878719a86e93 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7606e886554ff7948a4e246dd98677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3336309776d848efaf237863a5b9bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:02:51 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-2bc4b2bb-393f-4ec3-96f7-d01af26e503f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:02:51 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-efd2e634-f4a3-4713-b7fb-878719a86e93 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c" status: 200 len: 1208 microversion: 2.1 time: 0.142512 Apr 20 16:02:51 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 19/52] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:02:51 2023] GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c => generated 1208 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-a73b6f14-9a95-4024-95fb-42c632070a26 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-a73b6f14-9a95-4024-95fb-42c632070a26 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:02:51 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-2bc4b2bb-393f-4ec3-96f7-d01af26e503f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235" status: 200 len: 1235 microversion: 2.1 time: 0.171753 Apr 20 16:02:51 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 17/53] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:02:51 2023] GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 => generated 1235 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:02:51 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-a73b6f14-9a95-4024-95fb-42c632070a26 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:02:51 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-a73b6f14-9a95-4024-95fb-42c632070a26 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 200 len: 1211 microversion: 2.1 time: 0.090794 Apr 20 16:02:51 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 20/54] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:02:51 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Flavor limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Image limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Flavor pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Image pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Getting quotas for project fbbcfeb5266f4ca6b9738b18ba7d127e. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Getting quotas for user 48eeb9edc18f48f0ad13c819cdac9106 and project fbbcfeb5266f4ca6b9738b18ba7d127e. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Going to run 1 instances... {{(pid=61518) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:02:52 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:02:52 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-dc4c5aca-05b6-4b89-8249-daba730d9721 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.177197 Apr 20 16:02:52 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:02:50 2023] POST /compute/v2.1/servers => generated 403 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:02:52 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-f61e9d54-43e7-41e6-a348-5992ff496fca tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:02:52 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-f61e9d54-43e7-41e6-a348-5992ff496fca tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:02:52 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-f61e9d54-43e7-41e6-a348-5992ff496fca tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eeb9edc18f48f0ad13c819cdac9106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbcfeb5266f4ca6b9738b18ba7d127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:02:52 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-f61e9d54-43e7-41e6-a348-5992ff496fca tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81" status: 200 len: 1237 microversion: 2.1 time: 0.105304 Apr 20 16:02:52 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 18/56] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:02:52 2023] GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:02:53 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-577930116", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "545a57d8-9d55-4ace-a0ad-635d7bc0ae52"}], "security_groups": [{"name": "tempest-securitygroup--2083462947"}], "key_name": "tempest-keypair-1173247378", "user_data": "}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:53 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] validate_networks() for [('545a57d8-9d55-4ace-a0ad-635d7bc0ae52', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for user f50dbce30f294bb0ba6bc2811025835d and project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:02:55 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:02:55 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-e1ce0302-5ad4-4b0c-8429-ba00ad84a16f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.047985 Apr 20 16:02:55 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 21/57] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 16:02:53 2023] POST /compute/v2.1/servers => generated 400 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 16:02:55 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-08f40f6d-f0c9-4518-b21d-9cbfe853bbfa tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:02:55 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-08f40f6d-f0c9-4518-b21d-9cbfe853bbfa tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:02:55 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-08f40f6d-f0c9-4518-b21d-9cbfe853bbfa tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:02:55 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-08f40f6d-f0c9-4518-b21d-9cbfe853bbfa tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:02:55 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-08f40f6d-f0c9-4518-b21d-9cbfe853bbfa tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:02:55 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-08f40f6d-f0c9-4518-b21d-9cbfe853bbfa tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588" status: 200 len: 1275 microversion: 2.20 time: 0.140374 Apr 20 16:02:55 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:02:55 2023] GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-bf0d0ffd-6cf2-4ce8-8168-81ebf605576d req-24921570-59be-46fc-9589-76a3cece8581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f4b3d1-0fea-4378-94e3-c2bbfd8cad81", "tag": "b2af67f0-0768-4ebc-a21b-0ef6e2b3f264"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-bf0d0ffd-6cf2-4ce8-8168-81ebf605576d req-24921570-59be-46fc-9589-76a3cece8581 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-bf0d0ffd-6cf2-4ce8-8168-81ebf605576d req-24921570-59be-46fc-9589-76a3cece8581 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-bf0d0ffd-6cf2-4ce8-8168-81ebf605576d req-24921570-59be-46fc-9589-76a3cece8581 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-bf0d0ffd-6cf2-4ce8-8168-81ebf605576d req-24921570-59be-46fc-9589-76a3cece8581 service nova] Creating event network-changed:b2af67f0-0768-4ebc-a21b-0ef6e2b3f264 for instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 on user Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-bf0d0ffd-6cf2-4ce8-8168-81ebf605576d req-24921570-59be-46fc-9589-76a3cece8581 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61519) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-bf0d0ffd-6cf2-4ce8-8168-81ebf605576d req-24921570-59be-46fc-9589-76a3cece8581 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61519) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61519]: INFO nova.compute.rpcapi [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 16:02:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] Releasing lock "compute-rpcapi-router" {{(pid=61519) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 16:02:59 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-46075b4e-61b3-4b8f-bae2-55fc69075230 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164049 Apr 20 16:02:59 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 19/59] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:02:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-c4ebbf9c-17e1-464f-9452-bef2cbde2973 req-3bb9e808-c0e6-4398-a985-afdaf90e98a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d55e5bd-9b03-40a9-bca9-88545039597c", "tag": "fe98bff4-7b0f-4244-a254-fc9359c00aae"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c4ebbf9c-17e1-464f-9452-bef2cbde2973 req-3bb9e808-c0e6-4398-a985-afdaf90e98a7 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c4ebbf9c-17e1-464f-9452-bef2cbde2973 req-3bb9e808-c0e6-4398-a985-afdaf90e98a7 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c4ebbf9c-17e1-464f-9452-bef2cbde2973 req-3bb9e808-c0e6-4398-a985-afdaf90e98a7 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-8f934614-8628-4417-b8a1-e7214b266c16 req-8c7a3dc9-137c-405b-85b1-ed26e3a5218f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ea4d29-b178-4da2-b971-76f97031b244", "tag": "0b36b1a4-9ab6-49cb-9a5e-afc32792783e"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8f934614-8628-4417-b8a1-e7214b266c16 req-8c7a3dc9-137c-405b-85b1-ed26e3a5218f service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8f934614-8628-4417-b8a1-e7214b266c16 req-8c7a3dc9-137c-405b-85b1-ed26e3a5218f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8f934614-8628-4417-b8a1-e7214b266c16 req-8c7a3dc9-137c-405b-85b1-ed26e3a5218f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-c4ebbf9c-17e1-464f-9452-bef2cbde2973 req-3bb9e808-c0e6-4398-a985-afdaf90e98a7 service nova] Creating event network-changed:fe98bff4-7b0f-4244-a254-fc9359c00aae for instance 6d55e5bd-9b03-40a9-bca9-88545039597c on user Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c4ebbf9c-17e1-464f-9452-bef2cbde2973 req-3bb9e808-c0e6-4398-a985-afdaf90e98a7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61517) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c4ebbf9c-17e1-464f-9452-bef2cbde2973 req-3bb9e808-c0e6-4398-a985-afdaf90e98a7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61517) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61517]: INFO nova.compute.rpcapi [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 16:02:59 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] Releasing lock "compute-rpcapi-router" {{(pid=61517) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 16:02:59 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-dd41acd2-06fb-4ace-b8e2-bbcca9ffc583 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174621 Apr 20 16:02:59 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-8f934614-8628-4417-b8a1-e7214b266c16 req-8c7a3dc9-137c-405b-85b1-ed26e3a5218f service nova] Creating event network-changed:0b36b1a4-9ab6-49cb-9a5e-afc32792783e for instance d4ea4d29-b178-4da2-b971-76f97031b244 on user Apr 20 16:02:59 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 22/60] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:02:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8f934614-8628-4417-b8a1-e7214b266c16 req-8c7a3dc9-137c-405b-85b1-ed26e3a5218f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61518) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8f934614-8628-4417-b8a1-e7214b266c16 req-8c7a3dc9-137c-405b-85b1-ed26e3a5218f service nova] Acquired lock "compute-rpcapi-router" {{(pid=61518) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:02:59 user devstack@n-api.service[61518]: INFO nova.compute.rpcapi [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 16:02:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] Releasing lock "compute-rpcapi-router" {{(pid=61518) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 16:02:59 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-5a2c0843-8a0f-4f3d-9cc0-c82bb8e900f2 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188139 Apr 20 16:02:59 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:02:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:01 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-860312e7-9d2d-4f8e-820f-eb218f3b4b9e req-fba945ff-f740-4e46-918a-1bc309a34dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e68386-3b32-458b-9808-797d041c2235", "tag": "4bce4922-407c-4e11-b089-154a3299ea1c"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:01 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-860312e7-9d2d-4f8e-820f-eb218f3b4b9e req-fba945ff-f740-4e46-918a-1bc309a34dde service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:01 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-860312e7-9d2d-4f8e-820f-eb218f3b4b9e req-fba945ff-f740-4e46-918a-1bc309a34dde service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:01 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-860312e7-9d2d-4f8e-820f-eb218f3b4b9e req-fba945ff-f740-4e46-918a-1bc309a34dde service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:02 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-860312e7-9d2d-4f8e-820f-eb218f3b4b9e req-fba945ff-f740-4e46-918a-1bc309a34dde service nova] Creating event network-changed:4bce4922-407c-4e11-b089-154a3299ea1c for instance a5e68386-3b32-458b-9808-797d041c2235 on user Apr 20 16:03:02 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-860312e7-9d2d-4f8e-820f-eb218f3b4b9e req-fba945ff-f740-4e46-918a-1bc309a34dde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031616 Apr 20 16:03:02 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 20/62] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:05 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-67aff657-3e49-4b49-81d7-4895f0cd3e60 req-cdf4dfd2-385f-4e3b-9af9-e568f6621873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bda996a-1bfe-4f43-aa02-36a864153588", "tag": "5287c61f-56b9-4a9f-87e7-ab7057df84be"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:05 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-67aff657-3e49-4b49-81d7-4895f0cd3e60 req-cdf4dfd2-385f-4e3b-9af9-e568f6621873 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:05 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-67aff657-3e49-4b49-81d7-4895f0cd3e60 req-cdf4dfd2-385f-4e3b-9af9-e568f6621873 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:05 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-67aff657-3e49-4b49-81d7-4895f0cd3e60 req-cdf4dfd2-385f-4e3b-9af9-e568f6621873 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:05 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=20 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:05 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-67aff657-3e49-4b49-81d7-4895f0cd3e60 req-cdf4dfd2-385f-4e3b-9af9-e568f6621873 service nova] Creating event network-changed:5287c61f-56b9-4a9f-87e7-ab7057df84be for instance 5bda996a-1bfe-4f43-aa02-36a864153588 on user Apr 20 16:03:05 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-67aff657-3e49-4b49-81d7-4895f0cd3e60 req-cdf4dfd2-385f-4e3b-9af9-e568f6621873 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044320 Apr 20 16:03:05 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 23/63] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:07 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=18 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:07 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-8b34de21-0a0d-4408-a90b-3e36c080f5f4 req-7caf4b2b-e821-4ba3-978e-e40af379fd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e68386-3b32-458b-9808-797d041c2235", "name": "network-vif-plugged", "status": "completed", "tag": "4bce4922-407c-4e11-b089-154a3299ea1c"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:07 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8b34de21-0a0d-4408-a90b-3e36c080f5f4 req-7caf4b2b-e821-4ba3-978e-e40af379fd8a service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:07 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8b34de21-0a0d-4408-a90b-3e36c080f5f4 req-7caf4b2b-e821-4ba3-978e-e40af379fd8a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:07 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8b34de21-0a0d-4408-a90b-3e36c080f5f4 req-7caf4b2b-e821-4ba3-978e-e40af379fd8a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:07 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-8b34de21-0a0d-4408-a90b-3e36c080f5f4 req-7caf4b2b-e821-4ba3-978e-e40af379fd8a service nova] Creating event network-vif-plugged:4bce4922-407c-4e11-b089-154a3299ea1c for instance a5e68386-3b32-458b-9808-797d041c2235 on user Apr 20 16:03:07 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-8b34de21-0a0d-4408-a90b-3e36c080f5f4 req-7caf4b2b-e821-4ba3-978e-e40af379fd8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031748 Apr 20 16:03:07 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:09 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=10 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:09 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:09 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-a609f9dd-7a2d-45f7-b23f-53e6dab49936 req-fff486e5-b941-4fce-9d11-34972838c37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f4b3d1-0fea-4378-94e3-c2bbfd8cad81", "name": "network-vif-plugged", "status": "completed", "tag": "b2af67f0-0768-4ebc-a21b-0ef6e2b3f264"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:09 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a609f9dd-7a2d-45f7-b23f-53e6dab49936 req-fff486e5-b941-4fce-9d11-34972838c37b service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:09 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a609f9dd-7a2d-45f7-b23f-53e6dab49936 req-fff486e5-b941-4fce-9d11-34972838c37b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:09 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a609f9dd-7a2d-45f7-b23f-53e6dab49936 req-fff486e5-b941-4fce-9d11-34972838c37b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:09 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e68386-3b32-458b-9808-797d041c2235", "name": "network-vif-plugged", "status": "completed", "tag": "4bce4922-407c-4e11-b089-154a3299ea1c"}, {"server_uuid": "d4ea4d29-b178-4da2-b971-76f97031b244", "name": "network-vif-plugged", "status": "completed", "tag": "0b36b1a4-9ab6-49cb-9a5e-afc32792783e"}, {"server_uuid": "d4ea4d29-b178-4da2-b971-76f97031b244", "name": "network-vif-plugged", "status": "completed", "tag": "0b36b1a4-9ab6-49cb-9a5e-afc32792783e"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:09 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-a609f9dd-7a2d-45f7-b23f-53e6dab49936 req-fff486e5-b941-4fce-9d11-34972838c37b service nova] Creating event network-vif-plugged:b2af67f0-0768-4ebc-a21b-0ef6e2b3f264 for instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 on user Apr 20 16:03:09 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:09 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:09 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:09 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-a609f9dd-7a2d-45f7-b23f-53e6dab49936 req-fff486e5-b941-4fce-9d11-34972838c37b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034538 Apr 20 16:03:09 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:09 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] Creating event network-vif-plugged:4bce4922-407c-4e11-b089-154a3299ea1c for instance a5e68386-3b32-458b-9808-797d041c2235 on user Apr 20 16:03:09 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] Creating event network-vif-plugged:0b36b1a4-9ab6-49cb-9a5e-afc32792783e for instance d4ea4d29-b178-4da2-b971-76f97031b244 on user Apr 20 16:03:09 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] Creating event network-vif-plugged:0b36b1a4-9ab6-49cb-9a5e-afc32792783e for instance d4ea4d29-b178-4da2-b971-76f97031b244 on user Apr 20 16:03:09 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-32e94bfa-e0a0-4d17-93e0-22a4cb52008c req-80c7e9c9-bb7e-4656-a58f-3878958e4823 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035255 Apr 20 16:03:09 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 24/66] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:11 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-441a6f58-80b3-4689-9119-a8166d384573 req-594a6f67-ac68-4003-ac2a-c35f1b362728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda996a-1bfe-4f43-aa02-36a864153588", "name": "network-vif-plugged", "status": "completed", "tag": "5287c61f-56b9-4a9f-87e7-ab7057df84be"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:11 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-441a6f58-80b3-4689-9119-a8166d384573 req-594a6f67-ac68-4003-ac2a-c35f1b362728 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-441a6f58-80b3-4689-9119-a8166d384573 req-594a6f67-ac68-4003-ac2a-c35f1b362728 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-441a6f58-80b3-4689-9119-a8166d384573 req-594a6f67-ac68-4003-ac2a-c35f1b362728 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:11 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-441a6f58-80b3-4689-9119-a8166d384573 req-594a6f67-ac68-4003-ac2a-c35f1b362728 service nova] Creating event network-vif-plugged:5287c61f-56b9-4a9f-87e7-ab7057df84be for instance 5bda996a-1bfe-4f43-aa02-36a864153588 on user Apr 20 16:03:11 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-441a6f58-80b3-4689-9119-a8166d384573 req-594a6f67-ac68-4003-ac2a-c35f1b362728 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051901 Apr 20 16:03:11 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:11 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f4b3d1-0fea-4378-94e3-c2bbfd8cad81", "name": "network-vif-plugged", "status": "completed", "tag": "b2af67f0-0768-4ebc-a21b-0ef6e2b3f264"}, {"server_uuid": "6d55e5bd-9b03-40a9-bca9-88545039597c", "name": "network-vif-plugged", "status": "completed", "tag": "fe98bff4-7b0f-4244-a254-fc9359c00aae"}, {"server_uuid": "6d55e5bd-9b03-40a9-bca9-88545039597c", "name": "network-vif-plugged", "status": "completed", "tag": "fe98bff4-7b0f-4244-a254-fc9359c00aae"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:11 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:11 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:11 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:11 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:11 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] Creating event network-vif-plugged:b2af67f0-0768-4ebc-a21b-0ef6e2b3f264 for instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 on user Apr 20 16:03:11 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] Creating event network-vif-plugged:fe98bff4-7b0f-4244-a254-fc9359c00aae for instance 6d55e5bd-9b03-40a9-bca9-88545039597c on user Apr 20 16:03:11 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] Creating event network-vif-plugged:fe98bff4-7b0f-4244-a254-fc9359c00aae for instance 6d55e5bd-9b03-40a9-bca9-88545039597c on user Apr 20 16:03:11 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-185976cc-3261-4eb0-a054-3ed8f53b4245 req-b9edb87d-6211-48fc-b5f6-358f561c181e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055778 Apr 20 16:03:11 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:13 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:13 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-f031dbb1-a1b1-4276-beaa-810969b1f75a req-87277225-e967-408e-ad76-a23185866ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda996a-1bfe-4f43-aa02-36a864153588", "name": "network-vif-plugged", "status": "completed", "tag": "5287c61f-56b9-4a9f-87e7-ab7057df84be"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-f031dbb1-a1b1-4276-beaa-810969b1f75a req-87277225-e967-408e-ad76-a23185866ed2 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-f031dbb1-a1b1-4276-beaa-810969b1f75a req-87277225-e967-408e-ad76-a23185866ed2 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-f031dbb1-a1b1-4276-beaa-810969b1f75a req-87277225-e967-408e-ad76-a23185866ed2 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:13 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-f031dbb1-a1b1-4276-beaa-810969b1f75a req-87277225-e967-408e-ad76-a23185866ed2 service nova] Creating event network-vif-plugged:5287c61f-56b9-4a9f-87e7-ab7057df84be for instance 5bda996a-1bfe-4f43-aa02-36a864153588 on user Apr 20 16:03:13 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-f031dbb1-a1b1-4276-beaa-810969b1f75a req-87277225-e967-408e-ad76-a23185866ed2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102087 Apr 20 16:03:13 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 25/69] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:15 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-4beacbbf-c4a1-4dd0-92f0-eb2cd693ff46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Action: 'create', calling method: .version_select at 0x7f55884c32e0>, body: {"keypair": {"name": "tempest-keypair-1188279305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2/JSQECxpyAoht39JYGnv52skhhDoF+ZMQJeVxL2a6UlTIckPD/ph8VMozU2wYXOiMIRgZDapWk23cxn+Rk7SbiF9E3tzwwP5mxsK4xqXHETPbeDxqHRE+MDclya79IQ=="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:15 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-4beacbbf-c4a1-4dd0-92f0-eb2cd693ff46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Getting quotas for project 132831801cee4fb185cc27c9792ff5ad. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:15 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-4beacbbf-c4a1-4dd0-92f0-eb2cd693ff46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Getting quotas for user b21609ce02ce4ed2ba4f8f5d668da192 and project 132831801cee4fb185cc27c9792ff5ad. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:15 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-4beacbbf-c4a1-4dd0-92f0-eb2cd693ff46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.508260 Apr 20 16:03:15 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:03:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:20 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1701348631", "imageRef": "4c26d9f3-9ee3-471e-b427-e25c3c09175c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "0bc5d911-da2e-4f4e-9427-2332d7a5bd08"}], "security_groups": [{"name": "tempest-securitygroup--86220273"}], "key_name": "tempest-keypair-1188279305", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:21 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] validate_networks() for [('0bc5d911-da2e-4f4e-9427-2332d7a5bd08', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:03:21 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=12 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Getting quotas for project 132831801cee4fb185cc27c9792ff5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Getting quotas for user b21609ce02ce4ed2ba4f8f5d668da192 and project 132831801cee4fb185cc27c9792ff5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:03:23 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c26d9f3-9ee3-471e-b427-e25c3c09175c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:03:23 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-572d3e04-4cd7-488d-8910-f59e71f4984a tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.510295 Apr 20 16:03:23 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 23/71] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:03:20 2023] POST /compute/v2.1/servers => generated 402 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:03:23 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-43272a4c-cd9c-462c-af59-0f322371b0f2 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:23 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-43272a4c-cd9c-462c-af59-0f322371b0f2 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:23 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:23 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-43272a4c-cd9c-462c-af59-0f322371b0f2 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21609ce02ce4ed2ba4f8f5d668da192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132831801cee4fb185cc27c9792ff5ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:23 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-43272a4c-cd9c-462c-af59-0f322371b0f2 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab" status: 200 len: 1240 microversion: 2.1 time: 0.127331 Apr 20 16:03:23 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 26/72] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:23 2023] GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:29 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=12 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:29 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:29 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=8 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:29 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-0260c8d4-f8e2-45cc-990b-75b6a9c7fb77 tempest-TestShelveInstance-412281363 tempest-TestShelveInstance-412281363-project-member] Action: 'create', calling method: .version_select at 0x7f55884c28c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1694302270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/a/DvZT+yJcg250g2Xf6gy701WnX5V2LK3NtwwLUuN0LU0ET1tLn5r65wdx1QkQYsvxiwb2XEaePV/SZ8vmeH5MRigp1D59gP1WbsWh5ru9KuYvwudwCIEpZb4dLapCw=="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:29 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-0260c8d4-f8e2-45cc-990b-75b6a9c7fb77 tempest-TestShelveInstance-412281363 tempest-TestShelveInstance-412281363-project-member] Getting quotas for project c62b219cda8441eb9f775231a72ac4cf. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:29 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-0260c8d4-f8e2-45cc-990b-75b6a9c7fb77 tempest-TestShelveInstance-412281363 tempest-TestShelveInstance-412281363-project-member] Getting quotas for user 2a45b387117241b0bdda3a73941b892e and project c62b219cda8441eb9f775231a72ac4cf. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:29 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-0260c8d4-f8e2-45cc-990b-75b6a9c7fb77 tempest-TestShelveInstance-412281363 tempest-TestShelveInstance-412281363-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.303601 Apr 20 16:03:29 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 24/73] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:03:29 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:29 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-b7aa4b11-68a3-46b3-af12-56f02d8b0bf5 req-96c06e07-27e5-4734-9fee-7fe4ec72f249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc650d-2181-46cb-b91b-4a1104b2afab", "tag": "5c711d7a-9f6d-49dd-af46-c3c1056f702e"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:29 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b7aa4b11-68a3-46b3-af12-56f02d8b0bf5 req-96c06e07-27e5-4734-9fee-7fe4ec72f249 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:29 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b7aa4b11-68a3-46b3-af12-56f02d8b0bf5 req-96c06e07-27e5-4734-9fee-7fe4ec72f249 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:29 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b7aa4b11-68a3-46b3-af12-56f02d8b0bf5 req-96c06e07-27e5-4734-9fee-7fe4ec72f249 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:29 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-b7aa4b11-68a3-46b3-af12-56f02d8b0bf5 req-96c06e07-27e5-4734-9fee-7fe4ec72f249 service nova] Creating event network-changed:5c711d7a-9f6d-49dd-af46-c3c1056f702e for instance 65fc650d-2181-46cb-b91b-4a1104b2afab on user Apr 20 16:03:29 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-b7aa4b11-68a3-46b3-af12-56f02d8b0bf5 req-96c06e07-27e5-4734-9fee-7fe4ec72f249 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044601 Apr 20 16:03:29 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 24/74] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:32 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-1b120fbb-549d-4ab6-9ddb-23d9a829b97d req-141c6e0c-c675-4a1e-8ffd-b40d4f8cfd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc650d-2181-46cb-b91b-4a1104b2afab", "name": "network-vif-plugged", "status": "completed", "tag": "5c711d7a-9f6d-49dd-af46-c3c1056f702e"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:32 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=14 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1b120fbb-549d-4ab6-9ddb-23d9a829b97d req-141c6e0c-c675-4a1e-8ffd-b40d4f8cfd8f service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1b120fbb-549d-4ab6-9ddb-23d9a829b97d req-141c6e0c-c675-4a1e-8ffd-b40d4f8cfd8f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1b120fbb-549d-4ab6-9ddb-23d9a829b97d req-141c6e0c-c675-4a1e-8ffd-b40d4f8cfd8f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:32 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-1b120fbb-549d-4ab6-9ddb-23d9a829b97d req-141c6e0c-c675-4a1e-8ffd-b40d4f8cfd8f service nova] Creating event network-vif-plugged:5c711d7a-9f6d-49dd-af46-c3c1056f702e for instance 65fc650d-2181-46cb-b91b-4a1104b2afab on user Apr 20 16:03:32 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-1b120fbb-549d-4ab6-9ddb-23d9a829b97d req-141c6e0c-c675-4a1e-8ffd-b40d4f8cfd8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050848 Apr 20 16:03:32 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 27/75] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-913a48f1-88fe-4090-abe3-6772ee95e8a9 tempest-TestShelveInstance-412281363 tempest-TestShelveInstance-412281363-project-member] Calling method '.version_select at 0x7f5587b0c940>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:33 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-913a48f1-88fe-4090-abe3-6772ee95e8a9 tempest-TestShelveInstance-412281363 tempest-TestShelveInstance-412281363-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1694302270" status: 202 len: 0 microversion: 2.1 time: 0.024054 Apr 20 16:03:33 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 25/76] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 20 16:03:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1694302270 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:03:34 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:34 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:34 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-a805844b-f721-43d8-8098-b3f88f82d466 req-3208585b-9f20-4508-bbe6-28e0a1b9af7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc650d-2181-46cb-b91b-4a1104b2afab", "name": "network-vif-plugged", "status": "completed", "tag": "5c711d7a-9f6d-49dd-af46-c3c1056f702e"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a805844b-f721-43d8-8098-b3f88f82d466 req-3208585b-9f20-4508-bbe6-28e0a1b9af7f service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a805844b-f721-43d8-8098-b3f88f82d466 req-3208585b-9f20-4508-bbe6-28e0a1b9af7f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a805844b-f721-43d8-8098-b3f88f82d466 req-3208585b-9f20-4508-bbe6-28e0a1b9af7f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:34 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-a805844b-f721-43d8-8098-b3f88f82d466 req-3208585b-9f20-4508-bbe6-28e0a1b9af7f service nova] Creating event network-vif-plugged:5c711d7a-9f6d-49dd-af46-c3c1056f702e for instance 65fc650d-2181-46cb-b91b-4a1104b2afab on user Apr 20 16:03:34 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-a805844b-f721-43d8-8098-b3f88f82d466 req-3208585b-9f20-4508-bbe6-28e0a1b9af7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Apr 20 16:03:34 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 16:03:40 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-e763d969-8289-46d3-ae62-a976b502b787 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Action: 'create', calling method: .version_select at 0x7f55884bf9a0>, body: {"keypair": {"name": "tempest-keypair-2058378220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiDjegrCZQzggT2W88rJM8apM9Us8G90ElMugxXSgu6RWOdd7UNXIA5I2rSuifsaAIZ7hdjna3OuK6N+Oig2F4ghSuSm7pUTAMo6SzF09nfKRInfS2/IkPdA5ci5VCPuw=="}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-e763d969-8289-46d3-ae62-a976b502b787 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for project 77f831070f5847bda788f6f0fcfedb03. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-e763d969-8289-46d3-ae62-a976b502b787 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for user 1c8f57b12bc749888ea89bdbee258811 and project 77f831070f5847bda788f6f0fcfedb03. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:41 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-e763d969-8289-46d3-ae62-a976b502b787 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.236176 Apr 20 16:03:41 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 28/78] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:03:40 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] [instance: 6d55e5bd-9b03-40a9-bca9-88545039597c] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7606e886554ff7948a4e246dd98677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3336309776d848efaf237863a5b9bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:42 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-ea4fdff3-1654-42fe-af66-8e44b309b732 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c" status: 200 len: 1490 microversion: 2.1 time: 0.575226 Apr 20 16:03:42 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:41 2023] GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c => generated 1490 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:42 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:42 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-3ed291d7-6f8f-414f-89dd-408a2e41bb5d tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235" status: 200 len: 1544 microversion: 2.1 time: 0.980850 Apr 20 16:03:42 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 26/80] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:41 2023] GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 => generated 1544 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:42 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-71d133f6-114c-4964-8890-8f67e358a701 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 200 len: 1494 microversion: 2.1 time: 0.938145 Apr 20 16:03:42 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 29/81] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:41 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 1494 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:43 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eeb9edc18f48f0ad13c819cdac9106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbcfeb5266f4ca6b9738b18ba7d127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:43 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-d9eb841c-9d96-4f74-aa61-60bc8fbd7f9f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81" status: 200 len: 1551 microversion: 2.1 time: 0.335949 Apr 20 16:03:43 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 27/82] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:42 2023] GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 => generated 1551 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:43 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-943462612", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "27275346-fa92-4114-a62b-d59f0212eb8f"}], "security_groups": [{"name": "tempest-securitygroup--2086358185"}], "key_name": "tempest-keypair-2058378220", "user_data": "}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:43 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] validate_networks() for [('27275346-fa92-4114-a62b-d59f0212eb8f', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for project 77f831070f5847bda788f6f0fcfedb03. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for user 1c8f57b12bc749888ea89bdbee258811 and project 77f831070f5847bda788f6f0fcfedb03. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:03:45 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-46b31143-3bfb-48f5-97d6-d7cd760e13f0 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.893862 Apr 20 16:03:45 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 27/83] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:03:43 2023] POST /compute/v2.1/servers => generated 400 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:03:45 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-5568336f-ff24-43ee-99c8-f31429922f15 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:45 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-5568336f-ff24-43ee-99c8-f31429922f15 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:45 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2146872314", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:45 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] validate_networks() for [('4b5db782-8dbb-4f06-8e98-a794013dbc8c', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:03:45 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-5568336f-ff24-43ee-99c8-f31429922f15 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8f57b12bc749888ea89bdbee258811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f831070f5847bda788f6f0fcfedb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-5568336f-ff24-43ee-99c8-f31429922f15 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6" status: 200 len: 1231 microversion: 2.1 time: 0.324629 Apr 20 16:03:45 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 28/84] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:45 2023] GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 => generated 1231 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:46 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:46 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:46 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:46 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-21b389d5-b263-4e0e-82f2-d847e3b15552 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588" status: 200 len: 1587 microversion: 2.20 time: 0.385891 Apr 20 16:03:46 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 28/85] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:03:45 2023] GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 => generated 1587 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Getting quotas for project 1d4a73ba128147f295bf6a4545fede47. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Getting quotas for user e51e637e06d1475692c4055ae99121da and project 1d4a73ba128147f295bf6a4545fede47. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:03:46 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: e8f62d46-e2dc-4870-adf1-f62d88bb653b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:03:46 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-bbc47a67-5c04-448f-980d-e4392a6e5558 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.178593 Apr 20 16:03:46 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 30/86] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:03:45 2023] POST /compute/v2.1/servers => generated 381 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:03:46 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-863d9e97-bd1a-49f7-ab23-16389817daf5 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:46 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-863d9e97-bd1a-49f7-ab23-16389817daf5 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: e8f62d46-e2dc-4870-adf1-f62d88bb653b] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:46 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-863d9e97-bd1a-49f7-ab23-16389817daf5 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:46 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-863d9e97-bd1a-49f7-ab23-16389817daf5 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b" status: 200 len: 1216 microversion: 2.1 time: 0.083587 Apr 20 16:03:46 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 29/87] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:46 2023] GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:46 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1422609663", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:46 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] validate_networks() for [('4b5db782-8dbb-4f06-8e98-a794013dbc8c', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Getting quotas for project 1d4a73ba128147f295bf6a4545fede47. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Getting quotas for user e51e637e06d1475692c4055ae99121da and project 1d4a73ba128147f295bf6a4545fede47. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:03:47 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:03:47 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-cc1c18a3-19de-4d90-b0cf-4dd113b494e0 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.887948 Apr 20 16:03:47 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 29/88] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:03:46 2023] POST /compute/v2.1/servers => generated 381 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:03:47 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-7835c864-87a8-44ca-927a-bc5d4403e67a tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:47 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-7835c864-87a8-44ca-927a-bc5d4403e67a tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:47 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-7835c864-87a8-44ca-927a-bc5d4403e67a tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-7835c864-87a8-44ca-927a-bc5d4403e67a tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7" status: 200 len: 1216 microversion: 2.1 time: 0.130005 Apr 20 16:03:47 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:47 2023] GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 => generated 1216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:50 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-cd4311da-9da1-4b48-9f18-64a0b300d99f req-8ad95b84-040b-45a8-8292-cdf05a0684b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1036e0f-683f-4dfd-b0ad-6187d90ff2f6", "tag": "a0d0df58-0e84-4e27-bc44-3c5983d6d23b"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cd4311da-9da1-4b48-9f18-64a0b300d99f req-8ad95b84-040b-45a8-8292-cdf05a0684b3 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cd4311da-9da1-4b48-9f18-64a0b300d99f req-8ad95b84-040b-45a8-8292-cdf05a0684b3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cd4311da-9da1-4b48-9f18-64a0b300d99f req-8ad95b84-040b-45a8-8292-cdf05a0684b3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:50 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-cd4311da-9da1-4b48-9f18-64a0b300d99f req-8ad95b84-040b-45a8-8292-cdf05a0684b3 service nova] Creating event network-changed:a0d0df58-0e84-4e27-bc44-3c5983d6d23b for instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 on user Apr 20 16:03:50 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-cd4311da-9da1-4b48-9f18-64a0b300d99f req-8ad95b84-040b-45a8-8292-cdf05a0684b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037427 Apr 20 16:03:50 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 30/90] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:51 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-4f0d0756-d330-40ee-9daa-3356cdf07318 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Action: 'create', calling method: .version_select at 0x7f5587b06320>, body: {"keypair": {"name": "tempest-keypair-1405486078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvL2UEJPc4nJnMX0NLHsUyPpamaI8REueYO620VKU6jmG9moA3aOhnIV+8OJ4FygGtNs0JXD2mYZ/x6dT7j7bCftPAI8gs/5YWqGZxyEGNZggDwOTj0cc8sKDuS204Umw=="}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:51 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-4f0d0756-d330-40ee-9daa-3356cdf07318 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Getting quotas for project a92cea9e1182477ca669c506b42eda60. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:51 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-4f0d0756-d330-40ee-9daa-3356cdf07318 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Getting quotas for user c92692a1d38b4531a4e7f42660a54c7b and project a92cea9e1182477ca669c506b42eda60. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:51 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-4f0d0756-d330-40ee-9daa-3356cdf07318 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.224204 Apr 20 16:03:51 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 30/91] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:03:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:52 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-fc9ba2a1-6ae8-468e-9718-2475df971122 req-3914632d-dad7-4c2b-ade3-7eb5a7ea506c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f62d46-e2dc-4870-adf1-f62d88bb653b", "tag": "8200d42f-0f8f-439d-8ea8-1eea4fba54d6"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:52 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-fc9ba2a1-6ae8-468e-9718-2475df971122 req-3914632d-dad7-4c2b-ade3-7eb5a7ea506c service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:52 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-fc9ba2a1-6ae8-468e-9718-2475df971122 req-3914632d-dad7-4c2b-ade3-7eb5a7ea506c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:52 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-fc9ba2a1-6ae8-468e-9718-2475df971122 req-3914632d-dad7-4c2b-ade3-7eb5a7ea506c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:52 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-fc9ba2a1-6ae8-468e-9718-2475df971122 req-3914632d-dad7-4c2b-ade3-7eb5a7ea506c service nova] Creating event network-changed:8200d42f-0f8f-439d-8ea8-1eea4fba54d6 for instance e8f62d46-e2dc-4870-adf1-f62d88bb653b on user Apr 20 16:03:52 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-fc9ba2a1-6ae8-468e-9718-2475df971122 req-3914632d-dad7-4c2b-ade3-7eb5a7ea506c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044047 Apr 20 16:03:52 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:52 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-247130899", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "40132b20-6bfd-4f5a-8f6f-75769961d157"}], "security_groups": [{"name": "tempest-securitygroup--3839099"}], "key_name": "tempest-keypair-1405486078", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] validate_networks() for [('40132b20-6bfd-4f5a-8f6f-75769961d157', None, None, None, None, None)] {{(pid=61518) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Flavor limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Image limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Flavor pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Image pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Getting quotas for project a92cea9e1182477ca669c506b42eda60. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Getting quotas for user c92692a1d38b4531a4e7f42660a54c7b and project a92cea9e1182477ca669c506b42eda60. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Going to run 1 instances... {{(pid=61518) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:03:53 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:03:53 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-37a43ff0-48b5-4efe-a058-06b25bebfc7a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.977272 Apr 20 16:03:53 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:03:52 2023] POST /compute/v2.1/servers => generated 401 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:03:53 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-236f8cc1-b85a-4c02-b0f1-e45fb06ffa9a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:03:53 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-236f8cc1-b85a-4c02-b0f1-e45fb06ffa9a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:03:54 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-236f8cc1-b85a-4c02-b0f1-e45fb06ffa9a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92692a1d38b4531a4e7f42660a54c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92cea9e1182477ca669c506b42eda60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:03:54 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-236f8cc1-b85a-4c02-b0f1-e45fb06ffa9a tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854" status: 200 len: 1235 microversion: 2.1 time: 0.125272 Apr 20 16:03:54 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 31/94] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:03:53 2023] GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854 => generated 1235 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:03:54 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1036e0f-683f-4dfd-b0ad-6187d90ff2f6", "name": "network-vif-plugged", "status": "completed", "tag": "a0d0df58-0e84-4e27-bc44-3c5983d6d23b"}, {"server_uuid": "e1036e0f-683f-4dfd-b0ad-6187d90ff2f6", "name": "network-vif-plugged", "status": "completed", "tag": "a0d0df58-0e84-4e27-bc44-3c5983d6d23b"}, {"name": "network-changed", "server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:54 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:54 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:54 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:54 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:54 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] Creating event network-vif-plugged:a0d0df58-0e84-4e27-bc44-3c5983d6d23b for instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 on user Apr 20 16:03:54 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] Creating event network-vif-plugged:a0d0df58-0e84-4e27-bc44-3c5983d6d23b for instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 on user Apr 20 16:03:54 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] Creating event network-changed:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:03:54 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-f68a2da9-a93e-4f81-b05a-aecd9e589bdf req-e7717916-a61f-4669-958a-91e45e9e4c26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.058108 Apr 20 16:03:54 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 16:03:54 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-9e14682d-3a59-4cd8-9125-d1fcd74bdf7a req-3b4f6cc0-7bc8-4903-a2b8-bcfe19d66b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f62d46-e2dc-4870-adf1-f62d88bb653b", "name": "network-vif-plugged", "status": "completed", "tag": "8200d42f-0f8f-439d-8ea8-1eea4fba54d6"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:55 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-9e14682d-3a59-4cd8-9125-d1fcd74bdf7a req-3b4f6cc0-7bc8-4903-a2b8-bcfe19d66b32 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:55 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-9e14682d-3a59-4cd8-9125-d1fcd74bdf7a req-3b4f6cc0-7bc8-4903-a2b8-bcfe19d66b32 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:55 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-9e14682d-3a59-4cd8-9125-d1fcd74bdf7a req-3b4f6cc0-7bc8-4903-a2b8-bcfe19d66b32 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:55 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-9e14682d-3a59-4cd8-9125-d1fcd74bdf7a req-3b4f6cc0-7bc8-4903-a2b8-bcfe19d66b32 service nova] Creating event network-vif-plugged:8200d42f-0f8f-439d-8ea8-1eea4fba54d6 for instance e8f62d46-e2dc-4870-adf1-f62d88bb653b on user Apr 20 16:03:55 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-9e14682d-3a59-4cd8-9125-d1fcd74bdf7a req-3b4f6cc0-7bc8-4903-a2b8-bcfe19d66b32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126663 Apr 20 16:03:55 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:56 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-a973ffdd-407e-4309-9ce5-5cf072b6dd3a req-e9f79db4-b0da-4e5e-a31a-4c5d55f6788c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:57 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a973ffdd-407e-4309-9ce5-5cf072b6dd3a req-e9f79db4-b0da-4e5e-a31a-4c5d55f6788c service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:57 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a973ffdd-407e-4309-9ce5-5cf072b6dd3a req-e9f79db4-b0da-4e5e-a31a-4c5d55f6788c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:57 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a973ffdd-407e-4309-9ce5-5cf072b6dd3a req-e9f79db4-b0da-4e5e-a31a-4c5d55f6788c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:57 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=23 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:57 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-a973ffdd-407e-4309-9ce5-5cf072b6dd3a req-e9f79db4-b0da-4e5e-a31a-4c5d55f6788c service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:03:57 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-a973ffdd-407e-4309-9ce5-5cf072b6dd3a req-e9f79db4-b0da-4e5e-a31a-4c5d55f6788c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055131 Apr 20 16:03:57 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:57 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:03:57 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-9808404b-aa74-48e8-a446-4ad87cbb993a req-8facf5c7-205e-4d65-ac3b-f5178bc733a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f62d46-e2dc-4870-adf1-f62d88bb653b", "name": "network-vif-plugged", "status": "completed", "tag": "8200d42f-0f8f-439d-8ea8-1eea4fba54d6"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:57 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9808404b-aa74-48e8-a446-4ad87cbb993a req-8facf5c7-205e-4d65-ac3b-f5178bc733a3 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:57 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9808404b-aa74-48e8-a446-4ad87cbb993a req-8facf5c7-205e-4d65-ac3b-f5178bc733a3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:57 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9808404b-aa74-48e8-a446-4ad87cbb993a req-8facf5c7-205e-4d65-ac3b-f5178bc733a3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:57 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-9808404b-aa74-48e8-a446-4ad87cbb993a req-8facf5c7-205e-4d65-ac3b-f5178bc733a3 service nova] Creating event network-vif-plugged:8200d42f-0f8f-439d-8ea8-1eea4fba54d6 for instance e8f62d46-e2dc-4870-adf1-f62d88bb653b on user Apr 20 16:03:57 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-9808404b-aa74-48e8-a446-4ad87cbb993a req-8facf5c7-205e-4d65-ac3b-f5178bc733a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043961 Apr 20 16:03:57 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:03:59 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-f9a9a0ac-d905-4d3d-ae9e-f35253773d3c req-04d7a079-a529-401e-96ba-e5ad51bee183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"name": "network-changed", "server_uuid": "dc918ed4-8bc6-4a4f-a189-d6cdd5817854", "tag": "74703b46-6b03-4752-953b-9c64a63249c8"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:03:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-f9a9a0ac-d905-4d3d-ae9e-f35253773d3c req-04d7a079-a529-401e-96ba-e5ad51bee183 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:03:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-f9a9a0ac-d905-4d3d-ae9e-f35253773d3c req-04d7a079-a529-401e-96ba-e5ad51bee183 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:03:59 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-f9a9a0ac-d905-4d3d-ae9e-f35253773d3c req-04d7a079-a529-401e-96ba-e5ad51bee183 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:03:59 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-f9a9a0ac-d905-4d3d-ae9e-f35253773d3c req-04d7a079-a529-401e-96ba-e5ad51bee183 service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:03:59 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-f9a9a0ac-d905-4d3d-ae9e-f35253773d3c req-04d7a079-a529-401e-96ba-e5ad51bee183 service nova] Creating event network-changed:74703b46-6b03-4752-953b-9c64a63249c8 for instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 on user Apr 20 16:03:59 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-f9a9a0ac-d905-4d3d-ae9e-f35253773d3c req-04d7a079-a529-401e-96ba-e5ad51bee183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047825 Apr 20 16:03:59 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:03:59 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:00 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:00 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-09925632-1824-4ed1-a3ee-08dadf6683b6 req-b2351065-a771-436b-9faf-f5c7092246f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc918ed4-8bc6-4a4f-a189-d6cdd5817854", "name": "network-vif-plugged", "status": "completed", "tag": "74703b46-6b03-4752-953b-9c64a63249c8"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:00 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-09925632-1824-4ed1-a3ee-08dadf6683b6 req-b2351065-a771-436b-9faf-f5c7092246f3 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:00 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-09925632-1824-4ed1-a3ee-08dadf6683b6 req-b2351065-a771-436b-9faf-f5c7092246f3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:00 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-09925632-1824-4ed1-a3ee-08dadf6683b6 req-b2351065-a771-436b-9faf-f5c7092246f3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:00 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-09925632-1824-4ed1-a3ee-08dadf6683b6 req-b2351065-a771-436b-9faf-f5c7092246f3 service nova] Creating event network-vif-plugged:74703b46-6b03-4752-953b-9c64a63249c8 for instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 on user Apr 20 16:04:00 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-09925632-1824-4ed1-a3ee-08dadf6683b6 req-b2351065-a771-436b-9faf-f5c7092246f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038189 Apr 20 16:04:00 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 33/100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:02 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-d6d2fb4e-68b4-4825-97fd-6b851eefe268 req-0805ae4c-2494-42b6-9e2f-9d1fe327e9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc918ed4-8bc6-4a4f-a189-d6cdd5817854", "name": "network-vif-plugged", "status": "completed", "tag": "74703b46-6b03-4752-953b-9c64a63249c8"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:02 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=12 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:02 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-d6d2fb4e-68b4-4825-97fd-6b851eefe268 req-0805ae4c-2494-42b6-9e2f-9d1fe327e9b8 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:02 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-d6d2fb4e-68b4-4825-97fd-6b851eefe268 req-0805ae4c-2494-42b6-9e2f-9d1fe327e9b8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:02 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-d6d2fb4e-68b4-4825-97fd-6b851eefe268 req-0805ae4c-2494-42b6-9e2f-9d1fe327e9b8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:02 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-d6d2fb4e-68b4-4825-97fd-6b851eefe268 req-0805ae4c-2494-42b6-9e2f-9d1fe327e9b8 service nova] Creating event network-vif-plugged:74703b46-6b03-4752-953b-9c64a63249c8 for instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 on user Apr 20 16:04:02 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-d6d2fb4e-68b4-4825-97fd-6b851eefe268 req-0805ae4c-2494-42b6-9e2f-9d1fe327e9b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056931 Apr 20 16:04:02 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:03 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-a0136cfb-b707-493f-b5e8-1ab0fdbba629 tempest-TestStampPattern-2115713867 tempest-TestStampPattern-2115713867-project-member] Action: 'create', calling method: .version_select at 0x7f5587b0dfc0>, body: {"keypair": {"name": "tempest-TestStampPattern-35969264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpujOPaUIhNSTKrPAFULRa5IVpM671K5VLLMfyJ2ckx7003ac5rCqtTs9LHhIgBi8upxpYdFVylNalGWYqcwyogBSlD8V1kRGZmIOlp8IjdhouJI0QJeWtGYv/mMnSWKQ=="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:03 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:03 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-a0136cfb-b707-493f-b5e8-1ab0fdbba629 tempest-TestStampPattern-2115713867 tempest-TestStampPattern-2115713867-project-member] Getting quotas for project c0ab79a731a644729335d05468af89d3. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:04:03 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-a0136cfb-b707-493f-b5e8-1ab0fdbba629 tempest-TestStampPattern-2115713867 tempest-TestStampPattern-2115713867-project-member] Getting quotas for user 6970ee17a14c4c0e95dfa3dcc4bd5306 and project c0ab79a731a644729335d05468af89d3. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:04:03 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-a0136cfb-b707-493f-b5e8-1ab0fdbba629 tempest-TestStampPattern-2115713867 tempest-TestStampPattern-2115713867-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 393 microversion: 2.1 time: 0.319877 Apr 20 16:04:03 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 34/102] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:04:03 2023] POST /compute/v2.1/os-keypairs => generated 393 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:06 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=18 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:06 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-235efb6d-8abe-46e1-ae40-0941940e6312 tempest-TestStampPattern-2115713867 tempest-TestStampPattern-2115713867-project-member] Calling method '.version_select at 0x7f5587b06560>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:06 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-235efb6d-8abe-46e1-ae40-0941940e6312 tempest-TestStampPattern-2115713867 tempest-TestStampPattern-2115713867-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-35969264" status: 202 len: 0 microversion: 2.1 time: 0.026441 Apr 20 16:04:06 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1319 bytes} [Thu Apr 20 16:04:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-35969264 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=5 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=18 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:13 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21609ce02ce4ed2ba4f8f5d668da192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132831801cee4fb185cc27c9792ff5ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:13 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-64fdd5c4-aa23-4a16-8234-c2a0a8586d46 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab" status: 200 len: 1547 microversion: 2.1 time: 0.358091 Apr 20 16:04:13 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 36/104] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:04:13 2023] GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab => generated 1547 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=20 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=14 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:30 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-3d267ab9-bb5e-4413-b734-9182c0a410cf tempest-TestVolumeBootPattern-1883141841 tempest-TestVolumeBootPattern-1883141841-project-member] Action: 'create', calling method: .version_select at 0x7f5587b0c430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-897430752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ17UD92xTo7kR2/iI4kxoCLONtZaWX7wCN+rQO3MrAGiG7Lhe6Sw2tX+gCIfXqn700A2BvqPXBsCQZ3tlsHDZvX7pUobfq2G5gaox0QFfKBAMiSIPuTbJaVCl0XE4eXQ=="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:30 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-3d267ab9-bb5e-4413-b734-9182c0a410cf tempest-TestVolumeBootPattern-1883141841 tempest-TestVolumeBootPattern-1883141841-project-member] Getting quotas for project 8c5d12d785324451aa7ff2e16181dc75. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:04:30 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-3d267ab9-bb5e-4413-b734-9182c0a410cf tempest-TestVolumeBootPattern-1883141841 tempest-TestVolumeBootPattern-1883141841-project-member] Getting quotas for user 9f43211e495c42388f60361da49232d3 and project 8c5d12d785324451aa7ff2e16181dc75. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:04:30 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-3d267ab9-bb5e-4413-b734-9182c0a410cf tempest-TestVolumeBootPattern-1883141841 tempest-TestVolumeBootPattern-1883141841-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.051915 Apr 20 16:04:30 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 35/105] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:04:30 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:33 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:33 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-75cbf60c-1fdd-4e10-a37c-a0fd6ab112b7 tempest-TestVolumeBootPattern-1883141841 tempest-TestVolumeBootPattern-1883141841-project-member] Calling method '.version_select at 0x7f5587b7cf70>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-75cbf60c-1fdd-4e10-a37c-a0fd6ab112b7 tempest-TestVolumeBootPattern-1883141841 tempest-TestVolumeBootPattern-1883141841-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897430752" status: 202 len: 0 microversion: 2.1 time: 0.027792 Apr 20 16:04:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1337 bytes} [Thu Apr 20 16:04:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897430752 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:35 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8f57b12bc749888ea89bdbee258811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f831070f5847bda788f6f0fcfedb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-5bea4d06-6002-45ca-bed2-42654e866b90 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6" status: 200 len: 1536 microversion: 2.1 time: 0.275888 Apr 20 16:04:35 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 37/107] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:04:35 2023] GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 => generated 1536 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:38 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:38 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-13a02c5f-feaa-4ffe-aec5-417e47abd3f7 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7" status: 200 len: 1505 microversion: 2.1 time: 0.685770 Apr 20 16:04:38 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:04:37 2023] GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:42 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136804593", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "c36830a6-66f7-4f28-8879-e228da46cead"}]}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-661512d1-14f1-4fa7-9218-fad63cbbf20f tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.196368 Apr 20 16:04:43 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:04:42 2023] GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235/os-interface => generated 282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 16:04:43 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] validate_networks() for [('c36830a6-66f7-4f28-8879-e228da46cead', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:43 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:43 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-d494b7d6-c110-4767-a45b-bb386b108463 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.221235 Apr 20 16:04:43 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:04:43 2023] GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81/os-interface => generated 283 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] [instance: 6d55e5bd-9b03-40a9-bca9-88545039597c] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:43 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] [instance: 6d55e5bd-9b03-40a9-bca9-88545039597c] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:44 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-c4425233-7e2f-4a35-b20c-07012c2fd841 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c" status: 204 len: 0 microversion: 2.1 time: 0.307782 Apr 20 16:04:44 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:04:43 2023] DELETE /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] [instance: 6d55e5bd-9b03-40a9-bca9-88545039597c] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Getting quotas for project d8444d3c8f554a56967917670b19dc37. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Getting quotas for user 9be25e958c6047068ab5ce63106b0754 and project d8444d3c8f554a56967917670b19dc37. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:04:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-410e2754-fabc-4f13-b7f7-b37ec50815cd tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.475357 Apr 20 16:04:44 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 38/112] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:04:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-f212eb62-2ec2-46eb-b553-dfe28f2e970c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-f212eb62-2ec2-46eb-b553-dfe28f2e970c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-f212eb62-2ec2-46eb-b553-dfe28f2e970c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-f212eb62-2ec2-46eb-b553-dfe28f2e970c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412" status: 200 len: 1211 microversion: 2.1 time: 0.129384 Apr 20 16:04:44 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 39/113] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:04:44 2023] GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 => generated 1211 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:44 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92692a1d38b4531a4e7f42660a54c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92cea9e1182477ca669c506b42eda60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:44 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-7a9cacc8-4596-4b10-b1ab-cd46b9919efa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854" status: 200 len: 1541 microversion: 2.1 time: 0.607015 Apr 20 16:04:44 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:04:44 2023] GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854 => generated 1541 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-1005a8ff-044c-4fbe-803e-646fe4a4ae93 req-cf1a7827-6f0c-4639-98b8-4100cebfbe1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d55e5bd-9b03-40a9-bca9-88545039597c", "name": "network-vif-unplugged", "status": "completed", "tag": "fe98bff4-7b0f-4244-a254-fc9359c00aae"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1005a8ff-044c-4fbe-803e-646fe4a4ae93 req-cf1a7827-6f0c-4639-98b8-4100cebfbe1b service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1005a8ff-044c-4fbe-803e-646fe4a4ae93 req-cf1a7827-6f0c-4639-98b8-4100cebfbe1b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1005a8ff-044c-4fbe-803e-646fe4a4ae93 req-cf1a7827-6f0c-4639-98b8-4100cebfbe1b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-1005a8ff-044c-4fbe-803e-646fe4a4ae93 req-cf1a7827-6f0c-4639-98b8-4100cebfbe1b service nova] Creating event network-vif-unplugged:fe98bff4-7b0f-4244-a254-fc9359c00aae for instance 6d55e5bd-9b03-40a9-bca9-88545039597c on user Apr 20 16:04:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-1005a8ff-044c-4fbe-803e-646fe4a4ae93 req-cf1a7827-6f0c-4639-98b8-4100cebfbe1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046120 Apr 20 16:04:44 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 40/115] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7606e886554ff7948a4e246dd98677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3336309776d848efaf237863a5b9bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:45 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-e1b6bb40-ff1d-4c01-b11d-e777b05f92e7 tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c" status: 200 len: 1496 microversion: 2.1 time: 0.810538 Apr 20 16:04:45 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:04:44 2023] GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c => generated 1496 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:45 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-a5127230-c1c3-4b0b-bea0-c7371f7a15fd req-8816c017-a649-4e97-a4a0-f302eaad2165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e68386-3b32-458b-9808-797d041c2235", "tag": "4bce4922-407c-4e11-b089-154a3299ea1c"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-a5127230-c1c3-4b0b-bea0-c7371f7a15fd req-8816c017-a649-4e97-a4a0-f302eaad2165 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-a5127230-c1c3-4b0b-bea0-c7371f7a15fd req-8816c017-a649-4e97-a4a0-f302eaad2165 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-a5127230-c1c3-4b0b-bea0-c7371f7a15fd req-8816c017-a649-4e97-a4a0-f302eaad2165 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-a5127230-c1c3-4b0b-bea0-c7371f7a15fd req-8816c017-a649-4e97-a4a0-f302eaad2165 service nova] Creating event network-changed:4bce4922-407c-4e11-b089-154a3299ea1c for instance a5e68386-3b32-458b-9808-797d041c2235 on user Apr 20 16:04:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-a5127230-c1c3-4b0b-bea0-c7371f7a15fd req-8816c017-a649-4e97-a4a0-f302eaad2165 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032676 Apr 20 16:04:45 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:45 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-c1aba1fe-a9c2-472e-ad9c-00d4588cb219 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235/ips" status: 200 len: 107 microversion: 2.1 time: 0.073036 Apr 20 16:04:45 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 41/118] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:04:45 2023] GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235/ips => generated 107 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-694903509"}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:46 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-4dfee69b-ab3f-44c0-ab8e-e26832675a6a tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.183887 Apr 20 16:04:46 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 40/119] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 16:04:46 2023] GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588/os-interface => generated 282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 16:04:46 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-3cb2fc70-596e-415f-ac12-97d5c168e6dc tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81/action" status: 202 len: 0 microversion: 2.1 time: 0.906943 Apr 20 16:04:46 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 39/120] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 16:04:45 2023] POST /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 20 16:04:46 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-d2b68b2b-36ba-41ab-9eff-d23628584588 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '.version_select at 0x7f5587b11510>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:46 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-d2b68b2b-36ba-41ab-9eff-d23628584588 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91" status: 200 len: 1608 microversion: 2.1 time: 0.046482 Apr 20 16:04:46 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 16:04:46 2023] GET /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91 => generated 1608 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:46 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:04:46 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-bed97145-0d0b-4c2f-98f8-f1496db2ba1b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235" status: 204 len: 0 microversion: 2.1 time: 0.134156 Apr 20 16:04:46 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 41/122] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:04:46 2023] DELETE /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:46 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:46 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-a39603ef-4139-4283-b4da-ae09429d073c req-4188f1e4-d82a-4d8c-ac38-abcd6d42c6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d55e5bd-9b03-40a9-bca9-88545039597c", "name": "network-vif-plugged", "status": "completed", "tag": "fe98bff4-7b0f-4244-a254-fc9359c00aae"}, {"name": "network-changed", "server_uuid": "91f4b3d1-0fea-4378-94e3-c2bbfd8cad81", "tag": "b2af67f0-0768-4ebc-a21b-0ef6e2b3f264"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a39603ef-4139-4283-b4da-ae09429d073c req-4188f1e4-d82a-4d8c-ac38-abcd6d42c6e3 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a39603ef-4139-4283-b4da-ae09429d073c req-4188f1e4-d82a-4d8c-ac38-abcd6d42c6e3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a39603ef-4139-4283-b4da-ae09429d073c req-4188f1e4-d82a-4d8c-ac38-abcd6d42c6e3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-a39603ef-4139-4283-b4da-ae09429d073c req-4188f1e4-d82a-4d8c-ac38-abcd6d42c6e3 service nova] Creating event network-vif-plugged:fe98bff4-7b0f-4244-a254-fc9359c00aae for instance 6d55e5bd-9b03-40a9-bca9-88545039597c on user Apr 20 16:04:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-a39603ef-4139-4283-b4da-ae09429d073c req-4188f1e4-d82a-4d8c-ac38-abcd6d42c6e3 service nova] Creating event network-changed:b2af67f0-0768-4ebc-a21b-0ef6e2b3f264 for instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 on user Apr 20 16:04:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-a39603ef-4139-4283-b4da-ae09429d073c req-4188f1e4-d82a-4d8c-ac38-abcd6d42c6e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056452 Apr 20 16:04:47 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 43/123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:46 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:47 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-fb111c12-b3ef-4091-8bc6-37c024cbdf6f req-60c5761e-8dfb-4d03-9a1c-b7f43c388782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d55e5bd-9b03-40a9-bca9-88545039597c", "name": "network-vif-deleted", "tag": "fe98bff4-7b0f-4244-a254-fc9359c00aae"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:47 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-fb111c12-b3ef-4091-8bc6-37c024cbdf6f req-60c5761e-8dfb-4d03-9a1c-b7f43c388782 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:47 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-fb111c12-b3ef-4091-8bc6-37c024cbdf6f req-60c5761e-8dfb-4d03-9a1c-b7f43c388782 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:47 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-fb111c12-b3ef-4091-8bc6-37c024cbdf6f req-60c5761e-8dfb-4d03-9a1c-b7f43c388782 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:47 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-fb111c12-b3ef-4091-8bc6-37c024cbdf6f req-60c5761e-8dfb-4d03-9a1c-b7f43c388782 service nova] Creating event network-vif-deleted:fe98bff4-7b0f-4244-a254-fc9359c00aae for instance 6d55e5bd-9b03-40a9-bca9-88545039597c on user Apr 20 16:04:47 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-fb111c12-b3ef-4091-8bc6-37c024cbdf6f req-60c5761e-8dfb-4d03-9a1c-b7f43c388782 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038776 Apr 20 16:04:47 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:47 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-130cfb76-3537-4ac4-b806-47a611fd36b1 req-0e3130ac-2c50-4243-97e1-63e733704245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e68386-3b32-458b-9808-797d041c2235", "name": "network-vif-unplugged", "status": "completed", "tag": "4bce4922-407c-4e11-b089-154a3299ea1c"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-130cfb76-3537-4ac4-b806-47a611fd36b1 req-0e3130ac-2c50-4243-97e1-63e733704245 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-130cfb76-3537-4ac4-b806-47a611fd36b1 req-0e3130ac-2c50-4243-97e1-63e733704245 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-130cfb76-3537-4ac4-b806-47a611fd36b1 req-0e3130ac-2c50-4243-97e1-63e733704245 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-130cfb76-3537-4ac4-b806-47a611fd36b1 req-0e3130ac-2c50-4243-97e1-63e733704245 service nova] Creating event network-vif-unplugged:4bce4922-407c-4e11-b089-154a3299ea1c for instance a5e68386-3b32-458b-9808-797d041c2235 on user Apr 20 16:04:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-130cfb76-3537-4ac4-b806-47a611fd36b1 req-0e3130ac-2c50-4243-97e1-63e733704245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032102 Apr 20 16:04:47 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 44/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:47 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:47 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-8ba2344e-ac63-466a-8920-fbb349ac8b9a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235" status: 200 len: 1668 microversion: 2.1 time: 0.572606 Apr 20 16:04:47 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 40/126] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:04:46 2023] GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 => generated 1668 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:48 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:48 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-64d90d4d-ffbf-41d0-a6f3-642739200175 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588/ips" status: 200 len: 110 microversion: 2.20 time: 0.034239 Apr 20 16:04:48 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 43/127] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 16:04:48 2023] GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588/ips => generated 110 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 16:04:49 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-9b78b4c3-4356-410c-bfe4-67399656cb0e req-7a5fcc3f-a425-47dc-9a1c-f0add6a8fb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e68386-3b32-458b-9808-797d041c2235", "name": "network-vif-plugged", "status": "completed", "tag": "4bce4922-407c-4e11-b089-154a3299ea1c"}, {"name": "network-changed", "server_uuid": "5bda996a-1bfe-4f43-aa02-36a864153588", "tag": "5287c61f-56b9-4a9f-87e7-ab7057df84be"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:49 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9b78b4c3-4356-410c-bfe4-67399656cb0e req-7a5fcc3f-a425-47dc-9a1c-f0add6a8fb79 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:49 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9b78b4c3-4356-410c-bfe4-67399656cb0e req-7a5fcc3f-a425-47dc-9a1c-f0add6a8fb79 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:49 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9b78b4c3-4356-410c-bfe4-67399656cb0e req-7a5fcc3f-a425-47dc-9a1c-f0add6a8fb79 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:49 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-9b78b4c3-4356-410c-bfe4-67399656cb0e req-7a5fcc3f-a425-47dc-9a1c-f0add6a8fb79 service nova] Creating event network-vif-plugged:4bce4922-407c-4e11-b089-154a3299ea1c for instance a5e68386-3b32-458b-9808-797d041c2235 on user Apr 20 16:04:49 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-9b78b4c3-4356-410c-bfe4-67399656cb0e req-7a5fcc3f-a425-47dc-9a1c-f0add6a8fb79 service nova] Creating event network-changed:5287c61f-56b9-4a9f-87e7-ab7057df84be for instance 5bda996a-1bfe-4f43-aa02-36a864153588 on user Apr 20 16:04:49 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-9b78b4c3-4356-410c-bfe4-67399656cb0e req-7a5fcc3f-a425-47dc-9a1c-f0add6a8fb79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040639 Apr 20 16:04:49 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 45/128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:49 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:49 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:04:49 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-a863b487-23ba-40d2-9af2-26600527c08e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588" status: 204 len: 0 microversion: 2.20 time: 0.119865 Apr 20 16:04:49 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 41/129] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:04:49 2023] DELETE /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:49 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:04:49 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-ddfa5fdc-6024-4579-a6fa-f0223e4c05d9 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588" status: 200 len: 1593 microversion: 2.20 time: 0.167875 Apr 20 16:04:49 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 44/130] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:04:49 2023] GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 => generated 1593 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:04:50 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-74c489b6-ec18-4cdd-a608-72e8dcd03ed6 req-a566fad6-3aa1-48e8-8598-fa78ba2eb15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e68386-3b32-458b-9808-797d041c2235", "name": "network-vif-deleted", "tag": "4bce4922-407c-4e11-b089-154a3299ea1c"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:50 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-74c489b6-ec18-4cdd-a608-72e8dcd03ed6 req-a566fad6-3aa1-48e8-8598-fa78ba2eb15e service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:50 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-74c489b6-ec18-4cdd-a608-72e8dcd03ed6 req-a566fad6-3aa1-48e8-8598-fa78ba2eb15e service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:50 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-74c489b6-ec18-4cdd-a608-72e8dcd03ed6 req-a566fad6-3aa1-48e8-8598-fa78ba2eb15e service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:50 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-74c489b6-ec18-4cdd-a608-72e8dcd03ed6 req-a566fad6-3aa1-48e8-8598-fa78ba2eb15e service nova] Creating event network-vif-deleted:4bce4922-407c-4e11-b089-154a3299ea1c for instance a5e68386-3b32-458b-9808-797d041c2235 on user Apr 20 16:04:50 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-74c489b6-ec18-4cdd-a608-72e8dcd03ed6 req-a566fad6-3aa1-48e8-8598-fa78ba2eb15e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030326 Apr 20 16:04:50 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 46/131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:52 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda996a-1bfe-4f43-aa02-36a864153588", "name": "network-vif-unplugged", "status": "completed", "tag": "5287c61f-56b9-4a9f-87e7-ab7057df84be"}, {"name": "network-changed", "server_uuid": "dd78d74a-11d6-4f06-8092-5088b3fad412", "tag": "14dcc4ff-4a09-446a-b0ea-d9989cd3fa16"}, {"server_uuid": "5bda996a-1bfe-4f43-aa02-36a864153588", "name": "network-vif-plugged", "status": "completed", "tag": "5287c61f-56b9-4a9f-87e7-ab7057df84be"}, {"server_uuid": "5bda996a-1bfe-4f43-aa02-36a864153588", "name": "network-vif-deleted", "tag": "5287c61f-56b9-4a9f-87e7-ab7057df84be"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:52 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:52 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:52 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:52 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Creating event network-vif-unplugged:5287c61f-56b9-4a9f-87e7-ab7057df84be for instance 5bda996a-1bfe-4f43-aa02-36a864153588 on user Apr 20 16:04:52 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Creating event network-changed:14dcc4ff-4a09-446a-b0ea-d9989cd3fa16 for instance dd78d74a-11d6-4f06-8092-5088b3fad412 on user Apr 20 16:04:52 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Creating event network-vif-plugged:5287c61f-56b9-4a9f-87e7-ab7057df84be for instance 5bda996a-1bfe-4f43-aa02-36a864153588 on user Apr 20 16:04:52 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] Creating event network-vif-deleted:5287c61f-56b9-4a9f-87e7-ab7057df84be for instance 5bda996a-1bfe-4f43-aa02-36a864153588 on user Apr 20 16:04:52 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-8144e443-b9bf-41b4-a8e7-c2fb6c60b613 req-77b76ce3-c633-4bbf-84e1-536a55725df9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.044686 Apr 20 16:04:52 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 42/132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:52 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 16:04:53 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-197a310c-7bf6-433b-9619-a1314ab51358 req-d7a13878-4d1c-477c-8815-c0d7384ee3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd78d74a-11d6-4f06-8092-5088b3fad412", "name": "network-vif-plugged", "status": "completed", "tag": "14dcc4ff-4a09-446a-b0ea-d9989cd3fa16"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-197a310c-7bf6-433b-9619-a1314ab51358 req-d7a13878-4d1c-477c-8815-c0d7384ee3ec service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-197a310c-7bf6-433b-9619-a1314ab51358 req-d7a13878-4d1c-477c-8815-c0d7384ee3ec service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-197a310c-7bf6-433b-9619-a1314ab51358 req-d7a13878-4d1c-477c-8815-c0d7384ee3ec service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:53 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-197a310c-7bf6-433b-9619-a1314ab51358 req-d7a13878-4d1c-477c-8815-c0d7384ee3ec service nova] Creating event network-vif-plugged:14dcc4ff-4a09-446a-b0ea-d9989cd3fa16 for instance dd78d74a-11d6-4f06-8092-5088b3fad412 on user Apr 20 16:04:53 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-197a310c-7bf6-433b-9619-a1314ab51358 req-d7a13878-4d1c-477c-8815-c0d7384ee3ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028235 Apr 20 16:04:53 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:04:55 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:55 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=8 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:04:55 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-c75d0ba9-f81f-4afb-b87b-19bd57b2c176 req-3e9e615a-46ab-4273-8490-56905bbe2de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd78d74a-11d6-4f06-8092-5088b3fad412", "name": "network-vif-plugged", "status": "completed", "tag": "14dcc4ff-4a09-446a-b0ea-d9989cd3fa16"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:04:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c75d0ba9-f81f-4afb-b87b-19bd57b2c176 req-3e9e615a-46ab-4273-8490-56905bbe2de1 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:04:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c75d0ba9-f81f-4afb-b87b-19bd57b2c176 req-3e9e615a-46ab-4273-8490-56905bbe2de1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:04:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-c75d0ba9-f81f-4afb-b87b-19bd57b2c176 req-3e9e615a-46ab-4273-8490-56905bbe2de1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:04:55 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-c75d0ba9-f81f-4afb-b87b-19bd57b2c176 req-3e9e615a-46ab-4273-8490-56905bbe2de1 service nova] Creating event network-vif-plugged:14dcc4ff-4a09-446a-b0ea-d9989cd3fa16 for instance dd78d74a-11d6-4f06-8092-5088b3fad412 on user Apr 20 16:04:55 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-c75d0ba9-f81f-4afb-b87b-19bd57b2c176 req-3e9e615a-46ab-4273-8490-56905bbe2de1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032427 Apr 20 16:04:55 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 47/134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:04:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:13 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-5a622e23-5d40-479e-851c-ddfeddcbf266 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.173239 Apr 20 16:05:13 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 43/135] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:05:13 2023] GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab/os-interface => generated 282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:15 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:15 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:15 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-14f6d381-1bbd-473a-aa6a-5e3cc04e9b44 req-56255606-d34a-44bf-98df-1f9ec2459259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc650d-2181-46cb-b91b-4a1104b2afab", "tag": "5c711d7a-9f6d-49dd-af46-c3c1056f702e"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:15 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-14f6d381-1bbd-473a-aa6a-5e3cc04e9b44 req-56255606-d34a-44bf-98df-1f9ec2459259 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:15 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-14f6d381-1bbd-473a-aa6a-5e3cc04e9b44 req-56255606-d34a-44bf-98df-1f9ec2459259 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:15 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-14f6d381-1bbd-473a-aa6a-5e3cc04e9b44 req-56255606-d34a-44bf-98df-1f9ec2459259 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:15 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-14f6d381-1bbd-473a-aa6a-5e3cc04e9b44 req-56255606-d34a-44bf-98df-1f9ec2459259 service nova] Creating event network-changed:5c711d7a-9f6d-49dd-af46-c3c1056f702e for instance 65fc650d-2181-46cb-b91b-4a1104b2afab on user Apr 20 16:05:15 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-14f6d381-1bbd-473a-aa6a-5e3cc04e9b44 req-56255606-d34a-44bf-98df-1f9ec2459259 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039871 Apr 20 16:05:15 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=24 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:16 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:05:16 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-b0877cda-221a-4856-922b-214df6b5b016 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab" status: 204 len: 0 microversion: 2.1 time: 0.367585 Apr 20 16:05:16 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 48/137] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:05:16 2023] DELETE /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:17 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21609ce02ce4ed2ba4f8f5d668da192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132831801cee4fb185cc27c9792ff5ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:17 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-cb0d3490-9578-461f-9e09-1faa5c7f8167 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab" status: 200 len: 1671 microversion: 2.1 time: 0.168387 Apr 20 16:05:17 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 44/138] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:16 2023] GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 16:05:17 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-51afaac4-c8e9-42da-917d-f8f58e6c9794 req-3e793430-1de1-47bf-a52e-9b4cdeed743c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc650d-2181-46cb-b91b-4a1104b2afab", "name": "network-vif-unplugged", "status": "completed", "tag": "5c711d7a-9f6d-49dd-af46-c3c1056f702e"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-51afaac4-c8e9-42da-917d-f8f58e6c9794 req-3e793430-1de1-47bf-a52e-9b4cdeed743c service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-51afaac4-c8e9-42da-917d-f8f58e6c9794 req-3e793430-1de1-47bf-a52e-9b4cdeed743c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-51afaac4-c8e9-42da-917d-f8f58e6c9794 req-3e793430-1de1-47bf-a52e-9b4cdeed743c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:17 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-51afaac4-c8e9-42da-917d-f8f58e6c9794 req-3e793430-1de1-47bf-a52e-9b4cdeed743c service nova] Creating event network-vif-unplugged:5c711d7a-9f6d-49dd-af46-c3c1056f702e for instance 65fc650d-2181-46cb-b91b-4a1104b2afab on user Apr 20 16:05:17 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-51afaac4-c8e9-42da-917d-f8f58e6c9794 req-3e793430-1de1-47bf-a52e-9b4cdeed743c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034989 Apr 20 16:05:17 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:18 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-fb65a52b-3bfa-4bd0-ba16-2255f5d7547d req-2b51c10e-82f7-47c3-87e6-358cb846d164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc650d-2181-46cb-b91b-4a1104b2afab", "name": "network-vif-deleted", "tag": "5c711d7a-9f6d-49dd-af46-c3c1056f702e"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-fb65a52b-3bfa-4bd0-ba16-2255f5d7547d req-2b51c10e-82f7-47c3-87e6-358cb846d164 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-fb65a52b-3bfa-4bd0-ba16-2255f5d7547d req-2b51c10e-82f7-47c3-87e6-358cb846d164 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-fb65a52b-3bfa-4bd0-ba16-2255f5d7547d req-2b51c10e-82f7-47c3-87e6-358cb846d164 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:18 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-fb65a52b-3bfa-4bd0-ba16-2255f5d7547d req-2b51c10e-82f7-47c3-87e6-358cb846d164 service nova] Creating event network-vif-deleted:5c711d7a-9f6d-49dd-af46-c3c1056f702e for instance 65fc650d-2181-46cb-b91b-4a1104b2afab on user Apr 20 16:05:18 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-fb65a52b-3bfa-4bd0-ba16-2255f5d7547d req-2b51c10e-82f7-47c3-87e6-358cb846d164 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028204 Apr 20 16:05:18 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 49/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:19 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-e03dd3d2-79d1-4223-980c-85a8d481e123 req-9664f284-5ecb-4d91-b8a4-3dadf54ce271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc650d-2181-46cb-b91b-4a1104b2afab", "name": "network-vif-plugged", "status": "completed", "tag": "5c711d7a-9f6d-49dd-af46-c3c1056f702e"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e03dd3d2-79d1-4223-980c-85a8d481e123 req-9664f284-5ecb-4d91-b8a4-3dadf54ce271 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e03dd3d2-79d1-4223-980c-85a8d481e123 req-9664f284-5ecb-4d91-b8a4-3dadf54ce271 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e03dd3d2-79d1-4223-980c-85a8d481e123 req-9664f284-5ecb-4d91-b8a4-3dadf54ce271 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:19 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-e03dd3d2-79d1-4223-980c-85a8d481e123 req-9664f284-5ecb-4d91-b8a4-3dadf54ce271 service nova] Creating event network-vif-plugged:5c711d7a-9f6d-49dd-af46-c3c1056f702e for instance 65fc650d-2181-46cb-b91b-4a1104b2afab on user Apr 20 16:05:19 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-e03dd3d2-79d1-4223-980c-85a8d481e123 req-9664f284-5ecb-4d91-b8a4-3dadf54ce271 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027672 Apr 20 16:05:19 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 45/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:34 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:34 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-89aa39d1-505e-4204-baa8-0ec80884ea58 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412" status: 200 len: 1494 microversion: 2.1 time: 0.230838 Apr 20 16:05:34 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:34 2023] GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 => generated 1494 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] [instance: 6d55e5bd-9b03-40a9-bca9-88545039597c] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] HTTP exception thrown: Instance 6d55e5bd-9b03-40a9-bca9-88545039597c could not be found. Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Request method failure captured: Apr 20 16:05:35 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c HTTP/1.1 Apr 20 16:05:35 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:05:35 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:05:35 user devstack@n-api.service[61517]: Connection: close Apr 20 16:05:35 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:05:35 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:05:35 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:05:35 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:05:35 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWInglwENOE1_f2EBhIrwzJl09Li3I-C-oFROTmZSXYdx4lj90lMq8G7hqd6VtwhMtbhQDumVj4F_nUl2gDOZvay90ayMfo4Mwx7WtaDsNpucAN3h0F26MBiXNqZSpHTXXJA79z3ns9UkHra2ESr-WeLYC0cv27M4B6oh5CmQx21E8g Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Project-Id: 3336309776d848efaf237863a5b9bfeb Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Project-Name: tempest-DeleteServersTestJSON-1315524687 Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3336309776d848efaf237863a5b9bfeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3336309776d848efaf237863a5b9bfeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3336309776d848efaf237863a5b9bfeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Tenant: tempest-DeleteServersTestJSON-1315524687 Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Tenant-Id: 3336309776d848efaf237863a5b9bfeb Apr 20 16:05:35 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1315524687 Apr 20 16:05:35 user devstack@n-api.service[61517]: X-User: tempest-DeleteServersTestJSON-1315524687-project-member Apr 20 16:05:35 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:05:35 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:05:35 user devstack@n-api.service[61517]: X-User-Id: 8a7606e886554ff7948a4e246dd98677 Apr 20 16:05:35 user devstack@n-api.service[61517]: X-User-Name: tempest-DeleteServersTestJSON-1315524687-project-member Apr 20 16:05:35 user devstack@n-api.service[61517]: method: > Apr 20 16:05:35 user devstack@n-api.service[61517]: exception: Instance 6d55e5bd-9b03-40a9-bca9-88545039597c could not be found. Apr 20 16:05:35 user devstack@n-api.service[61517]: action_args: {'id': '6d55e5bd-9b03-40a9-bca9-88545039597c'} Apr 20 16:05:35 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d55e5bd-9b03-40a9-bca9-88545039597c could not be found. Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d55e5bd-9b03-40a9-bca9-88545039597c could not be found. Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d55e5bd-9b03-40a9-bca9-88545039597c could not be found. Apr 20 16:05:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] Returning 404 to user: Instance 6d55e5bd-9b03-40a9-bca9-88545039597c could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:05:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-0f1117b5-fa5d-41bf-8fab-cbaf116157ca tempest-DeleteServersTestJSON-1315524687 tempest-DeleteServersTestJSON-1315524687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c" status: 404 len: 111 microversion: 2.1 time: 0.044803 Apr 20 16:05:35 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 50/143] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:35 2023] GET /compute/v2.1/servers/6d55e5bd-9b03-40a9-bca9-88545039597c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=12 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:36 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-41031326-acc8-44c0-b6a7-5f4ec2b915a9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.177703 Apr 20 16:05:36 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 46/144] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:05:36 2023] GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6/os-interface => generated 282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:36 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-225553c7-89a2-46c8-9a83-edb699655e50 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '.version_select at 0x7f5587b85e10>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:36 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-225553c7-89a2-46c8-9a83-edb699655e50 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91" status: 200 len: 1722 microversion: 2.1 time: 0.066723 Apr 20 16:05:36 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 49/145] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 16:05:36 2023] GET /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91 => generated 1722 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:36 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-a1734954-3c2d-40bf-94dc-64dda51ef192 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '.version_select at 0x7f5587ad7760>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-a1734954-3c2d-40bf-94dc-64dda51ef192 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91" status: 200 len: 1722 microversion: 2.1 time: 0.055907 Apr 20 16:05:36 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 51/146] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 16:05:36 2023] GET /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91 => generated 1722 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eeb9edc18f48f0ad13c819cdac9106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbcfeb5266f4ca6b9738b18ba7d127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:37 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-dd0071a7-dafc-4253-897a-b421b3ed0daa tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81" status: 200 len: 1670 microversion: 2.1 time: 0.446599 Apr 20 16:05:37 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 47/147] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:36 2023] GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 => generated 1670 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:37 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-9792e975-6615-42a6-84c9-a34fd76c898a req-3fedcd34-3477-4656-adc5-a5b0912b0096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1036e0f-683f-4dfd-b0ad-6187d90ff2f6", "tag": "a0d0df58-0e84-4e27-bc44-3c5983d6d23b"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-9792e975-6615-42a6-84c9-a34fd76c898a req-3fedcd34-3477-4656-adc5-a5b0912b0096 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-9792e975-6615-42a6-84c9-a34fd76c898a req-3fedcd34-3477-4656-adc5-a5b0912b0096 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-9792e975-6615-42a6-84c9-a34fd76c898a req-3fedcd34-3477-4656-adc5-a5b0912b0096 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-9792e975-6615-42a6-84c9-a34fd76c898a req-3fedcd34-3477-4656-adc5-a5b0912b0096 service nova] Creating event network-changed:a0d0df58-0e84-4e27-bc44-3c5983d6d23b for instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 on user Apr 20 16:05:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-9792e975-6615-42a6-84c9-a34fd76c898a req-3fedcd34-3477-4656-adc5-a5b0912b0096 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135189 Apr 20 16:05:37 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 50/148] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:37 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:05:37 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 HTTP/1.1 Apr 20 16:05:37 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:05:37 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:05:37 user devstack@n-api.service[61517]: Connection: close Apr 20 16:05:37 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:05:37 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:05:37 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:05:37 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:05:37 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:05:37 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:05:37 user devstack@n-api.service[61517]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:05:37 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:05:37 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:05:37 user devstack@n-api.service[61517]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:05:37 user devstack@n-api.service[61517]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:05:37 user devstack@n-api.service[61517]: method: > Apr 20 16:05:37 user devstack@n-api.service[61517]: exception: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:05:37 user devstack@n-api.service[61517]: action_args: {'id': 'a5e68386-3b32-458b-9808-797d041c2235'} Apr 20 16:05:37 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:05:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:05:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:05:37 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-cbdd2f3f-9be9-4632-b241-1707cec4b885 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235" status: 404 len: 111 microversion: 2.1 time: 0.038459 Apr 20 16:05:37 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 52/149] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:37 2023] GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:05:37 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-92850fbb-4aeb-467f-963e-b54e49568177 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '.version_select at 0x7f5587b87b50>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:37 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-11e7ed67-f8c9-4e88-aa46-26254a7ff3d5 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6/ips" status: 200 len: 103 microversion: 2.1 time: 0.035519 Apr 20 16:05:37 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 48/150] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:05:37 2023] GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6/ips => generated 103 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-92850fbb-4aeb-467f-963e-b54e49568177 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817335126" status: 202 len: 0 microversion: 2.1 time: 0.024237 Apr 20 16:05:37 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 51/151] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 16:05:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817335126 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:05:38 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-87a0dcee-1c79-436a-ab3b-0f94ec2ef3b4 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Action: 'create', calling method: .version_select at 0x7f5587ad75b0>, body: {"keypair": {"name": "tempest-keypair-1502137074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/e6+xMI0YH6Nw89h/OWSpnukYpq8WmC7TXM/G8CwHs84ixak8UdfgaeBRkeLKS6hBuTod5w5YIWjrhnSQwR7L2FaQ72Z5mCu+hRUU2g4pFa5raukmqUiXrVuyvOpMkNQ=="}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:38 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-87a0dcee-1c79-436a-ab3b-0f94ec2ef3b4 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for project 71cf2664111f45788d24092e8ceede9c. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:05:38 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-87a0dcee-1c79-436a-ab3b-0f94ec2ef3b4 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for user 690c49feae904687826fb959ba5ba283 and project 71cf2664111f45788d24092e8ceede9c. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:05:38 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-87a0dcee-1c79-436a-ab3b-0f94ec2ef3b4 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048468 Apr 20 16:05:38 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 53/152] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:05:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:38 user devstack@n-api.service[61519]: DEBUG nova.objects.instance [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lazy-loading 'flavor' on Instance uuid fe0bde76-a4f8-4865-91af-2bd3790587a7 {{(pid=61519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 16:05:38 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-5e7cc138-b1c6-4100-ad42-f03cb4fbbcc2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7/action" status: 200 len: 32 microversion: 2.1 time: 0.138903 Apr 20 16:05:38 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 49/153] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 16:05:38 2023] POST /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7/action => generated 32 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:38 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:38 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e970c5af-8525-4a4b-9d4a-7ab99541325f tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7" status: 200 len: 1511 microversion: 2.1 time: 0.287946 Apr 20 16:05:38 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 52/154] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:38 2023] GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:05:39 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-03d3aa40-47e4-46c3-93d1-c8b07ad5d339 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6" status: 204 len: 0 microversion: 2.1 time: 0.206699 Apr 20 16:05:39 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 54/155] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:05:39 2023] DELETE /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:39 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8f57b12bc749888ea89bdbee258811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f831070f5847bda788f6f0fcfedb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:39 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-781dc2c6-8f8b-4ad0-9d9a-ea66f0eed3bd tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6" status: 200 len: 1660 microversion: 2.1 time: 0.224044 Apr 20 16:05:39 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 50/156] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:39 2023] GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 => generated 1660 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:39 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-eeb1ca6e-960f-4b23-a6e2-7e6321872946 req-a081f9a2-54e3-49e6-88a6-eb26635802d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1036e0f-683f-4dfd-b0ad-6187d90ff2f6", "name": "network-vif-unplugged", "status": "completed", "tag": "a0d0df58-0e84-4e27-bc44-3c5983d6d23b"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-eeb1ca6e-960f-4b23-a6e2-7e6321872946 req-a081f9a2-54e3-49e6-88a6-eb26635802d2 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-eeb1ca6e-960f-4b23-a6e2-7e6321872946 req-a081f9a2-54e3-49e6-88a6-eb26635802d2 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-eeb1ca6e-960f-4b23-a6e2-7e6321872946 req-a081f9a2-54e3-49e6-88a6-eb26635802d2 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:39 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-eeb1ca6e-960f-4b23-a6e2-7e6321872946 req-a081f9a2-54e3-49e6-88a6-eb26635802d2 service nova] Creating event network-vif-unplugged:a0d0df58-0e84-4e27-bc44-3c5983d6d23b for instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 on user Apr 20 16:05:39 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-eeb1ca6e-960f-4b23-a6e2-7e6321872946 req-a081f9a2-54e3-49e6-88a6-eb26635802d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032143 Apr 20 16:05:39 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:39 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1498143817", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2dc9b3da-0124-4718-9f70-a131cd030480"}], "security_groups": [{"name": "tempest-securitygroup--1490188347"}], "key_name": "tempest-keypair-1502137074", "user_data": "}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:40 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] HTTP exception thrown: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Request method failure captured: Apr 20 16:05:40 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 HTTP/1.1 Apr 20 16:05:40 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:05:40 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:05:40 user devstack@n-api.service[61519]: Connection: close Apr 20 16:05:40 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:05:40 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:05:40 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:05:40 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:05:40 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWInXta5nx85YTf4JKYtG4PaASCPKsMF2yEgjqMuO3z2joKUKuU4k255Y8HcFoZKO2QvY3kyzt_1Hj-TcVl1WY6lMRWzZg5Hcs-srpz6pdOJnOUBL5t4McD0QCpjCcVAsdWBqYj6M-8jFdJ91JyK4SGGQLcExoh-S32sWe3NXPj0Hb4 Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Project-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Tenant-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:05:40 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:05:40 user devstack@n-api.service[61519]: X-User: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:05:40 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:05:40 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:05:40 user devstack@n-api.service[61519]: X-User-Id: f50dbce30f294bb0ba6bc2811025835d Apr 20 16:05:40 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:05:40 user devstack@n-api.service[61519]: method: > Apr 20 16:05:40 user devstack@n-api.service[61519]: exception: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:05:40 user devstack@n-api.service[61519]: action_args: {'id': '5bda996a-1bfe-4f43-aa02-36a864153588'} Apr 20 16:05:40 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:05:40 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Returning 404 to user: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:05:40 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-25bd68c4-386b-4421-aa3b-7a28c62b6e74 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588" status: 404 len: 111 microversion: 2.20 time: 0.036133 Apr 20 16:05:40 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 51/158] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:05:40 2023] GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:05:40 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-0116ab83-86ab-40f1-b9de-c7202f88ae84 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '.version_select at 0x7f5587b0c3a0>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:40 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-0116ab83-86ab-40f1-b9de-c7202f88ae84 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173247378" status: 204 len: 0 microversion: 2.20 time: 0.024611 Apr 20 16:05:40 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 54/159] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 16:05:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173247378 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:05:40 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] validate_networks() for [('2dc9b3da-0124-4718-9f70-a131cd030480', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-8dea367e-055a-457f-a84d-5be01e536ad7 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Action: 'create', calling method: .version_select at 0x7f558798dcf0>, body: {"keypair": {"name": "tempest-keypair-297016939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVMEOOD2DPBjhKcYiA5lmZjVYxh9PWLGO75MzhXO3aLsn0kBvkh5hqWzAscvsUYLQELbD8L/orvsrJrdTwkd7/EBmpsdlVzjqkj4vcLr/kYQYhKCohu26BkQL4kIIGz1A=="}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-8dea367e-055a-457f-a84d-5be01e536ad7 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:05:40 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-8dea367e-055a-457f-a84d-5be01e536ad7 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for user f50dbce30f294bb0ba6bc2811025835d and project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:05:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-8dea367e-055a-457f-a84d-5be01e536ad7 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048349 Apr 20 16:05:41 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 52/160] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 16:05:40 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for project 71cf2664111f45788d24092e8ceede9c. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for user 690c49feae904687826fb959ba5ba283 and project 71cf2664111f45788d24092e8ceede9c. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:05:41 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:05:41 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-38980c95-62f3-4bd1-a667-16fa8265d2e7 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.425427 Apr 20 16:05:41 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 55/161] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:05:39 2023] POST /compute/v2.1/servers => generated 400 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:05:41 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-d8bcbf1a-2333-43bd-946b-bb820ee9a7d6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:41 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-d8bcbf1a-2333-43bd-946b-bb820ee9a7d6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:41 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-d8bcbf1a-2333-43bd-946b-bb820ee9a7d6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:41 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-d8bcbf1a-2333-43bd-946b-bb820ee9a7d6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a" status: 200 len: 1236 microversion: 2.1 time: 0.117780 Apr 20 16:05:41 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:41 2023] GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a => generated 1236 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:41 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1036e0f-683f-4dfd-b0ad-6187d90ff2f6", "name": "network-vif-plugged", "status": "completed", "tag": "a0d0df58-0e84-4e27-bc44-3c5983d6d23b"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-unplugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Creating event network-vif-plugged:a0d0df58-0e84-4e27-bc44-3c5983d6d23b for instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 on user Apr 20 16:05:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Creating event network-vif-unplugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-d7a27313-9144-4878-a973-a80719d2b801 req-48569e0d-9f28-4712-a557-6cada4bcbfa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.061241 Apr 20 16:05:41 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 53/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:42 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-924389841", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "545a57d8-9d55-4ace-a0ad-635d7bc0ae52"}], "security_groups": [{"name": "tempest-securitygroup--98663270"}], "key_name": "tempest-keypair-297016939", "user_data": "}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:42 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] validate_networks() for [('545a57d8-9d55-4ace-a0ad-635d7bc0ae52', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Getting quotas for user f50dbce30f294bb0ba6bc2811025835d and project cb0a5eb3796a4d3a871843f409c6ffbd. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:05:43 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:05:43 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-2c704a99-6f91-4bca-89fe-d39409556b75 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.20 time: 0.644373 Apr 20 16:05:43 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 56/164] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 16:05:42 2023] POST /compute/v2.1/servers => generated 398 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 16:05:43 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-dd694e2c-2662-45e9-bb6f-f2c04e3186be tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:43 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-dd694e2c-2662-45e9-bb6f-f2c04e3186be tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:43 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-dd694e2c-2662-45e9-bb6f-f2c04e3186be tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:43 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-dd694e2c-2662-45e9-bb6f-f2c04e3186be tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:43 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-dd694e2c-2662-45e9-bb6f-f2c04e3186be tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:43 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-dd694e2c-2662-45e9-bb6f-f2c04e3186be tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48" status: 200 len: 1274 microversion: 2.20 time: 0.098599 Apr 20 16:05:43 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 56/165] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:05:43 2023] GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:05:43 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-unplugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "e1036e0f-683f-4dfd-b0ad-6187d90ff2f6", "name": "network-vif-deleted", "tag": "a0d0df58-0e84-4e27-bc44-3c5983d6d23b"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Creating event network-vif-unplugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Creating event network-vif-deleted:a0d0df58-0e84-4e27-bc44-3c5983d6d23b for instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 on user Apr 20 16:05:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:05:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-27e68161-02a6-467e-bb68-1db3659f3ef9 req-f28e2992-0f70-44c9-8f66-1514d4ce0bcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.034680 Apr 20 16:05:43 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 54/166] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:43 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:45 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ef260a18-f277-4d53-8822-bc306d0a62ee tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.310917 Apr 20 16:05:45 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:05:44 2023] GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854/os-interface => generated 282 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:46 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-483eca30-c1f7-437c-a143-bfd493ec573e req-4750b284-37f9-4a6b-8285-914f2fce4685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc918ed4-8bc6-4a4f-a189-d6cdd5817854", "tag": "74703b46-6b03-4752-953b-9c64a63249c8"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-483eca30-c1f7-437c-a143-bfd493ec573e req-4750b284-37f9-4a6b-8285-914f2fce4685 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-483eca30-c1f7-437c-a143-bfd493ec573e req-4750b284-37f9-4a6b-8285-914f2fce4685 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:46 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-483eca30-c1f7-437c-a143-bfd493ec573e req-4750b284-37f9-4a6b-8285-914f2fce4685 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:46 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-483eca30-c1f7-437c-a143-bfd493ec573e req-4750b284-37f9-4a6b-8285-914f2fce4685 service nova] Creating event network-changed:74703b46-6b03-4752-953b-9c64a63249c8 for instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 on user Apr 20 16:05:46 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-483eca30-c1f7-437c-a143-bfd493ec573e req-4750b284-37f9-4a6b-8285-914f2fce4685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037112 Apr 20 16:05:46 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:47 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1165125210", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "40132b20-6bfd-4f5a-8f6f-75769961d157"}]}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:47 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] validate_networks() for [('40132b20-6bfd-4f5a-8f6f-75769961d157', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:05:48 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-381b645c-f37a-47e1-836e-7fa39861d112 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Action: 'create', calling method: .version_select at 0x7f5587ad7a30>, body: {"keypair": {"name": "tempest-keypair-1949594234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjwUpDWFcob5xB4VqDuXPX9FXT3Oo4If754w5lrosRMsv11HN44JSOF4mrro0tvAJdzBl68kfqgDpMmfJchN9rJpHKumya051JNHX7iD1cSwO0dYRTlSqqNhb1fgqIedQ=="}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:48 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-381b645c-f37a-47e1-836e-7fa39861d112 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Getting quotas for project fbd2a72dddad4f2892243a33df4fa2d1. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:05:48 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-381b645c-f37a-47e1-836e-7fa39861d112 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Getting quotas for user dd6dee2194d04f45a81fd0ef45ca0632 and project fbd2a72dddad4f2892243a33df4fa2d1. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:05:48 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-381b645c-f37a-47e1-836e-7fa39861d112 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179853 Apr 20 16:05:48 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 58/169] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:05:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:49 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-8caaa124-e0e7-49ac-98d3-42533cad44e2 req-cff0caed-62d3-401a-9b02-5c272a880972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b84ca2-f67b-4219-b7e6-18d2029e998a", "tag": "9e814c79-86f6-46ce-9473-d87fb7e67641"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8caaa124-e0e7-49ac-98d3-42533cad44e2 req-cff0caed-62d3-401a-9b02-5c272a880972 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8caaa124-e0e7-49ac-98d3-42533cad44e2 req-cff0caed-62d3-401a-9b02-5c272a880972 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:49 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8caaa124-e0e7-49ac-98d3-42533cad44e2 req-cff0caed-62d3-401a-9b02-5c272a880972 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:49 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-8caaa124-e0e7-49ac-98d3-42533cad44e2 req-cff0caed-62d3-401a-9b02-5c272a880972 service nova] Creating event network-changed:9e814c79-86f6-46ce-9473-d87fb7e67641 for instance c2b84ca2-f67b-4219-b7e6-18d2029e998a on user Apr 20 16:05:49 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-8caaa124-e0e7-49ac-98d3-42533cad44e2 req-cff0caed-62d3-401a-9b02-5c272a880972 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033490 Apr 20 16:05:49 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Getting quotas for project a92cea9e1182477ca669c506b42eda60. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Getting quotas for user c92692a1d38b4531a4e7f42660a54c7b and project a92cea9e1182477ca669c506b42eda60. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:05:49 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: a145fb51-4ca5-4cc4-b8bd-cd3665bef473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:05:49 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-fe38d8a9-aa47-4dc3-abb1-9ea4878bee76 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.899835 Apr 20 16:05:49 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 55/171] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:05:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:05:49 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-1f4c1abb-bd72-4bb0-8a9b-b1873e0a6f95 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:49 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-1f4c1abb-bd72-4bb0-8a9b-b1873e0a6f95 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: a145fb51-4ca5-4cc4-b8bd-cd3665bef473] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:49 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-756269820", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9de26342-0f6c-4d7d-96a5-d4ad35573211"}], "security_groups": [{"name": "tempest-securitygroup--1517394998"}], "key_name": "tempest-keypair-1949594234", "user_data": "}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:49 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-1f4c1abb-bd72-4bb0-8a9b-b1873e0a6f95 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92692a1d38b4531a4e7f42660a54c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92cea9e1182477ca669c506b42eda60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:49 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-1f4c1abb-bd72-4bb0-8a9b-b1873e0a6f95 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473" status: 200 len: 1212 microversion: 2.1 time: 0.125234 Apr 20 16:05:49 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 59/172] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:49 2023] GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473 => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:49 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] validate_networks() for [('9de26342-0f6c-4d7d-96a5-d4ad35573211', None, None, None, None, None)] {{(pid=61518) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Flavor limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Image limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Flavor pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Image pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Getting quotas for project fbd2a72dddad4f2892243a33df4fa2d1. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Getting quotas for user dd6dee2194d04f45a81fd0ef45ca0632 and project fbd2a72dddad4f2892243a33df4fa2d1. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Going to run 1 instances... {{(pid=61518) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:05:50 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:05:50 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-c84a10b6-cde9-4caf-9c19-f5e4efc9fe11 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.806700 Apr 20 16:05:50 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 59/173] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:05:49 2023] POST /compute/v2.1/servers => generated 407 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:05:50 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-15ed53e8-a0e0-4410-8c5a-45fdb1920b01 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:05:50 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-15ed53e8-a0e0-4410-8c5a-45fdb1920b01 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:05:50 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-15ed53e8-a0e0-4410-8c5a-45fdb1920b01 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:05:50 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-15ed53e8-a0e0-4410-8c5a-45fdb1920b01 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1232 microversion: 2.1 time: 0.076789 Apr 20 16:05:50 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 56/174] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:05:50 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1232 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:05:51 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-37ffeb6b-a261-454a-84c4-e50909a5c4a8 req-aec5403c-a664-4b53-a164-def50481aa27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a760987f-1a65-4e42-8cef-73db9ef2db48", "tag": "cac4dfaa-510a-4330-b9b1-aeb25f57abef"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-37ffeb6b-a261-454a-84c4-e50909a5c4a8 req-aec5403c-a664-4b53-a164-def50481aa27 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-37ffeb6b-a261-454a-84c4-e50909a5c4a8 req-aec5403c-a664-4b53-a164-def50481aa27 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:51 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-37ffeb6b-a261-454a-84c4-e50909a5c4a8 req-aec5403c-a664-4b53-a164-def50481aa27 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:51 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-37ffeb6b-a261-454a-84c4-e50909a5c4a8 req-aec5403c-a664-4b53-a164-def50481aa27 service nova] Creating event network-changed:cac4dfaa-510a-4330-b9b1-aeb25f57abef for instance a760987f-1a65-4e42-8cef-73db9ef2db48 on user Apr 20 16:05:51 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-37ffeb6b-a261-454a-84c4-e50909a5c4a8 req-aec5403c-a664-4b53-a164-def50481aa27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035442 Apr 20 16:05:51 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:53 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-281cf31d-7082-480f-8c1c-ba31cb113077 req-febb4c65-8c16-4355-a0c7-c793f91f13b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b84ca2-f67b-4219-b7e6-18d2029e998a", "name": "network-vif-plugged", "status": "completed", "tag": "9e814c79-86f6-46ce-9473-d87fb7e67641"}, {"server_uuid": "c2b84ca2-f67b-4219-b7e6-18d2029e998a", "name": "network-vif-plugged", "status": "completed", "tag": "9e814c79-86f6-46ce-9473-d87fb7e67641"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-281cf31d-7082-480f-8c1c-ba31cb113077 req-febb4c65-8c16-4355-a0c7-c793f91f13b6 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-281cf31d-7082-480f-8c1c-ba31cb113077 req-febb4c65-8c16-4355-a0c7-c793f91f13b6 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:53 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-281cf31d-7082-480f-8c1c-ba31cb113077 req-febb4c65-8c16-4355-a0c7-c793f91f13b6 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:53 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-281cf31d-7082-480f-8c1c-ba31cb113077 req-febb4c65-8c16-4355-a0c7-c793f91f13b6 service nova] Creating event network-vif-plugged:9e814c79-86f6-46ce-9473-d87fb7e67641 for instance c2b84ca2-f67b-4219-b7e6-18d2029e998a on user Apr 20 16:05:53 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-281cf31d-7082-480f-8c1c-ba31cb113077 req-febb4c65-8c16-4355-a0c7-c793f91f13b6 service nova] Creating event network-vif-plugged:9e814c79-86f6-46ce-9473-d87fb7e67641 for instance c2b84ca2-f67b-4219-b7e6-18d2029e998a on user Apr 20 16:05:53 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-281cf31d-7082-480f-8c1c-ba31cb113077 req-febb4c65-8c16-4355-a0c7-c793f91f13b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033247 Apr 20 16:05:53 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 60/176] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:55 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a760987f-1a65-4e42-8cef-73db9ef2db48", "name": "network-vif-plugged", "status": "completed", "tag": "cac4dfaa-510a-4330-b9b1-aeb25f57abef"}, {"server_uuid": "a760987f-1a65-4e42-8cef-73db9ef2db48", "name": "network-vif-plugged", "status": "completed", "tag": "cac4dfaa-510a-4330-b9b1-aeb25f57abef"}, {"name": "network-changed", "server_uuid": "a145fb51-4ca5-4cc4-b8bd-cd3665bef473", "tag": "989ee5cd-ff10-4bcc-9b11-017b23299187"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:55 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:55 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:55 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:55 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] Creating event network-vif-plugged:cac4dfaa-510a-4330-b9b1-aeb25f57abef for instance a760987f-1a65-4e42-8cef-73db9ef2db48 on user Apr 20 16:05:55 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] Creating event network-vif-plugged:cac4dfaa-510a-4330-b9b1-aeb25f57abef for instance a760987f-1a65-4e42-8cef-73db9ef2db48 on user Apr 20 16:05:55 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] Creating event network-changed:989ee5cd-ff10-4bcc-9b11-017b23299187 for instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 on user Apr 20 16:05:55 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-5dfcb976-321a-477e-a7a3-ae0e38e7de52 req-2851231d-0fe4-44ba-91c2-37b795e62904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.036270 Apr 20 16:05:55 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 57/177] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:55 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 16:05:57 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:05:57 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-ce4162ad-f1b4-437b-8f65-d114db990c03 req-1c26f8a9-a3c3-4a27-be68-7568729f29dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d42ba7-cf47-4374-83b5-06d5242951b7", "tag": "e068d7e5-dc70-4b18-8dd6-5726f7a3bc84"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:57 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ce4162ad-f1b4-437b-8f65-d114db990c03 req-1c26f8a9-a3c3-4a27-be68-7568729f29dc service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:57 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ce4162ad-f1b4-437b-8f65-d114db990c03 req-1c26f8a9-a3c3-4a27-be68-7568729f29dc service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:57 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ce4162ad-f1b4-437b-8f65-d114db990c03 req-1c26f8a9-a3c3-4a27-be68-7568729f29dc service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:57 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-ce4162ad-f1b4-437b-8f65-d114db990c03 req-1c26f8a9-a3c3-4a27-be68-7568729f29dc service nova] Creating event network-changed:e068d7e5-dc70-4b18-8dd6-5726f7a3bc84 for instance 15d42ba7-cf47-4374-83b5-06d5242951b7 on user Apr 20 16:05:57 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-ce4162ad-f1b4-437b-8f65-d114db990c03 req-1c26f8a9-a3c3-4a27-be68-7568729f29dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040372 Apr 20 16:05:57 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 61/178] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:58 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-2224ad67-9b34-475d-81b8-8f7ac516132f req-c9287b9e-18d6-41d3-a61c-511f590737c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a145fb51-4ca5-4cc4-b8bd-cd3665bef473", "name": "network-vif-plugged", "status": "completed", "tag": "989ee5cd-ff10-4bcc-9b11-017b23299187"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-2224ad67-9b34-475d-81b8-8f7ac516132f req-c9287b9e-18d6-41d3-a61c-511f590737c7 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-2224ad67-9b34-475d-81b8-8f7ac516132f req-c9287b9e-18d6-41d3-a61c-511f590737c7 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-2224ad67-9b34-475d-81b8-8f7ac516132f req-c9287b9e-18d6-41d3-a61c-511f590737c7 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:58 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-2224ad67-9b34-475d-81b8-8f7ac516132f req-c9287b9e-18d6-41d3-a61c-511f590737c7 service nova] Creating event network-vif-plugged:989ee5cd-ff10-4bcc-9b11-017b23299187 for instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 on user Apr 20 16:05:58 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-2224ad67-9b34-475d-81b8-8f7ac516132f req-c9287b9e-18d6-41d3-a61c-511f590737c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035075 Apr 20 16:05:58 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 61/179] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:05:59 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-dc70b210-db2a-4f3d-9fa9-47e550da6e0d req-86842ffd-e5ff-441b-976a-8d51e864a039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d42ba7-cf47-4374-83b5-06d5242951b7", "name": "network-vif-plugged", "status": "completed", "tag": "e068d7e5-dc70-4b18-8dd6-5726f7a3bc84"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:05:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-dc70b210-db2a-4f3d-9fa9-47e550da6e0d req-86842ffd-e5ff-441b-976a-8d51e864a039 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:05:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-dc70b210-db2a-4f3d-9fa9-47e550da6e0d req-86842ffd-e5ff-441b-976a-8d51e864a039 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:05:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-dc70b210-db2a-4f3d-9fa9-47e550da6e0d req-86842ffd-e5ff-441b-976a-8d51e864a039 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:05:59 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-dc70b210-db2a-4f3d-9fa9-47e550da6e0d req-86842ffd-e5ff-441b-976a-8d51e864a039 service nova] Creating event network-vif-plugged:e068d7e5-dc70-4b18-8dd6-5726f7a3bc84 for instance 15d42ba7-cf47-4374-83b5-06d5242951b7 on user Apr 20 16:05:59 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-dc70b210-db2a-4f3d-9fa9-47e550da6e0d req-86842ffd-e5ff-441b-976a-8d51e864a039 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038294 Apr 20 16:05:59 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 58/180] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:00 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-bbeabd21-0e47-45a4-8d5a-bb910649a6a7 req-66045cd9-4351-481d-9090-52a5228d54b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a145fb51-4ca5-4cc4-b8bd-cd3665bef473", "name": "network-vif-plugged", "status": "completed", "tag": "989ee5cd-ff10-4bcc-9b11-017b23299187"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:00 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=22 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:00 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-bbeabd21-0e47-45a4-8d5a-bb910649a6a7 req-66045cd9-4351-481d-9090-52a5228d54b4 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:00 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-bbeabd21-0e47-45a4-8d5a-bb910649a6a7 req-66045cd9-4351-481d-9090-52a5228d54b4 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:00 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-bbeabd21-0e47-45a4-8d5a-bb910649a6a7 req-66045cd9-4351-481d-9090-52a5228d54b4 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:00 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-bbeabd21-0e47-45a4-8d5a-bb910649a6a7 req-66045cd9-4351-481d-9090-52a5228d54b4 service nova] Creating event network-vif-plugged:989ee5cd-ff10-4bcc-9b11-017b23299187 for instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 on user Apr 20 16:06:00 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-bbeabd21-0e47-45a4-8d5a-bb910649a6a7 req-66045cd9-4351-481d-9090-52a5228d54b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030733 Apr 20 16:06:00 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:01 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:01 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=10 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:01 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-2310c2f7-d723-4609-88f7-5745ee7f5811 req-b6359646-6b64-4e13-834f-e283b994c993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d42ba7-cf47-4374-83b5-06d5242951b7", "name": "network-vif-plugged", "status": "completed", "tag": "e068d7e5-dc70-4b18-8dd6-5726f7a3bc84"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-2310c2f7-d723-4609-88f7-5745ee7f5811 req-b6359646-6b64-4e13-834f-e283b994c993 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-2310c2f7-d723-4609-88f7-5745ee7f5811 req-b6359646-6b64-4e13-834f-e283b994c993 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-2310c2f7-d723-4609-88f7-5745ee7f5811 req-b6359646-6b64-4e13-834f-e283b994c993 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:01 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-2310c2f7-d723-4609-88f7-5745ee7f5811 req-b6359646-6b64-4e13-834f-e283b994c993 service nova] Creating event network-vif-plugged:e068d7e5-dc70-4b18-8dd6-5726f7a3bc84 for instance 15d42ba7-cf47-4374-83b5-06d5242951b7 on user Apr 20 16:06:01 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-2310c2f7-d723-4609-88f7-5745ee7f5811 req-b6359646-6b64-4e13-834f-e283b994c993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039971 Apr 20 16:06:01 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 62/182] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=12 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:07 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] HTTP exception thrown: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Request method failure captured: Apr 20 16:06:07 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab HTTP/1.1 Apr 20 16:06:07 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:06:07 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:06:07 user devstack@n-api.service[61519]: Connection: close Apr 20 16:06:07 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:06:07 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:06:07 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:06:07 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:06:07 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWImzLuyDh3uFFgE1rCHCtr0nk04xEjIVIw8u1fsFlOq5sGNweSzMEV6E-bivZoFyBxdDP1DNf--jo1knsKeMkVMxIPwAAgzfPxhtQKNPmNVOA4t8kCCMfULpLkESE9nREHpMncPgpySqB7Y6sbOuv_B-x9qqNUZKLYtCyOwXdaL4J4 Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Project-Id: 132831801cee4fb185cc27c9792ff5ad Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Tenant-Id: 132831801cee4fb185cc27c9792ff5ad Apr 20 16:06:07 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:07 user devstack@n-api.service[61519]: X-User: tempest-AttachSCSIVolumeTestJSON-838012861-project-member Apr 20 16:06:07 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:06:07 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:06:07 user devstack@n-api.service[61519]: X-User-Id: b21609ce02ce4ed2ba4f8f5d668da192 Apr 20 16:06:07 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-838012861-project-member Apr 20 16:06:07 user devstack@n-api.service[61519]: method: > Apr 20 16:06:07 user devstack@n-api.service[61519]: exception: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:07 user devstack@n-api.service[61519]: action_args: {'id': '65fc650d-2181-46cb-b91b-4a1104b2afab'} Apr 20 16:06:07 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:07 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:07 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Returning 404 to user: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:06:07 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-e2b005ed-86cc-44f9-9a29-af7c4a901eae tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab" status: 404 len: 111 microversion: 2.1 time: 0.034298 Apr 20 16:06:07 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 59/183] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:07 2023] GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:06:07 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-2854cadf-0dad-4fde-8d6f-674668c3b7ab tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '.version_select at 0x7f5587ad72e0>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:07 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:07 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-2854cadf-0dad-4fde-8d6f-674668c3b7ab tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188279305" status: 202 len: 0 microversion: 2.1 time: 0.038293 Apr 20 16:06:07 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 63/184] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 16:06:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188279305 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=29 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:08 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] HTTP exception thrown: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Request method failure captured: Apr 20 16:06:08 user devstack@n-api.service[61518]: request: DELETE /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab HTTP/1.1 Apr 20 16:06:08 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:06:08 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:06:08 user devstack@n-api.service[61518]: Connection: close Apr 20 16:06:08 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:06:08 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:06:08 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:06:08 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:06:08 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWImzLuyDh3uFFgE1rCHCtr0nk04xEjIVIw8u1fsFlOq5sGNweSzMEV6E-bivZoFyBxdDP1DNf--jo1knsKeMkVMxIPwAAgzfPxhtQKNPmNVOA4t8kCCMfULpLkESE9nREHpMncPgpySqB7Y6sbOuv_B-x9qqNUZKLYtCyOwXdaL4J4 Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Project-Id: 132831801cee4fb185cc27c9792ff5ad Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Tenant-Id: 132831801cee4fb185cc27c9792ff5ad Apr 20 16:06:08 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:08 user devstack@n-api.service[61518]: X-User: tempest-AttachSCSIVolumeTestJSON-838012861-project-member Apr 20 16:06:08 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:06:08 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:06:08 user devstack@n-api.service[61518]: X-User-Id: b21609ce02ce4ed2ba4f8f5d668da192 Apr 20 16:06:08 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-838012861-project-member Apr 20 16:06:08 user devstack@n-api.service[61518]: method: > Apr 20 16:06:08 user devstack@n-api.service[61518]: exception: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61518]: action_args: {'id': '65fc650d-2181-46cb-b91b-4a1104b2afab'} Apr 20 16:06:08 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Returning 404 to user: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:06:08 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-32c4370e-d4ee-4cd1-abf8-919e0c6c4716 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab" status: 404 len: 111 microversion: 2.1 time: 0.037945 Apr 20 16:06:08 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:06:08 2023] DELETE /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] [instance: 65fc650d-2181-46cb-b91b-4a1104b2afab] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:08 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] HTTP exception thrown: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Request method failure captured: Apr 20 16:06:08 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab HTTP/1.1 Apr 20 16:06:08 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:06:08 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:06:08 user devstack@n-api.service[61519]: Connection: close Apr 20 16:06:08 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:06:08 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:06:08 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:06:08 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:06:08 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWImzLuyDh3uFFgE1rCHCtr0nk04xEjIVIw8u1fsFlOq5sGNweSzMEV6E-bivZoFyBxdDP1DNf--jo1knsKeMkVMxIPwAAgzfPxhtQKNPmNVOA4t8kCCMfULpLkESE9nREHpMncPgpySqB7Y6sbOuv_B-x9qqNUZKLYtCyOwXdaL4J4 Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Project-Id: 132831801cee4fb185cc27c9792ff5ad Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/132831801cee4fb185cc27c9792ff5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Tenant-Id: 132831801cee4fb185cc27c9792ff5ad Apr 20 16:06:08 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-838012861 Apr 20 16:06:08 user devstack@n-api.service[61519]: X-User: tempest-AttachSCSIVolumeTestJSON-838012861-project-member Apr 20 16:06:08 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:06:08 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:06:08 user devstack@n-api.service[61519]: X-User-Id: b21609ce02ce4ed2ba4f8f5d668da192 Apr 20 16:06:08 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-838012861-project-member Apr 20 16:06:08 user devstack@n-api.service[61519]: method: > Apr 20 16:06:08 user devstack@n-api.service[61519]: exception: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61519]: action_args: {'id': '65fc650d-2181-46cb-b91b-4a1104b2afab'} Apr 20 16:06:08 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. Apr 20 16:06:08 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:06:08 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] Returning 404 to user: Instance 65fc650d-2181-46cb-b91b-4a1104b2afab could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:06:08 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-1153e9f4-3459-4bb6-bbc7-18735a6c9345 tempest-AttachSCSIVolumeTestJSON-838012861 tempest-AttachSCSIVolumeTestJSON-838012861-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab" status: 404 len: 111 microversion: 2.1 time: 0.028886 Apr 20 16:06:08 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 60/186] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:08 2023] GET /compute/v2.1/servers/65fc650d-2181-46cb-b91b-4a1104b2afab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:29 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:29 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-bd39c8bc-11ec-4688-8b3e-1693e206eea9 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7" status: 200 len: 1491 microversion: 2.1 time: 0.236986 Apr 20 16:06:29 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 64/187] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:29 2023] GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 => generated 1491 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:29 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] HTTP exception thrown: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Request method failure captured: Apr 20 16:06:29 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 HTTP/1.1 Apr 20 16:06:29 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:06:29 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:06:29 user devstack@n-api.service[61518]: Connection: close Apr 20 16:06:29 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:06:29 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:06:29 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:06:29 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:06:29 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWJc1a0Gx-g20_AaUh2nbxzQ2AradtMfrLXtmX5w-wxUNFe97uqHcInR5ZKifxXevUVh5gr-MbZSJkEfmXl4nQy40QvTTxHuujqDw5s2eTIssS5jeRy52R2OzB574FRTjIolL9RGhjqOXFdohiV90HAz1GsrbBOQO9M0uoZAfan2SpM Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Project-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Tenant-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:06:29 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:06:29 user devstack@n-api.service[61518]: X-User: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:06:29 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:06:29 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:06:29 user devstack@n-api.service[61518]: X-User-Id: 1c8f57b12bc749888ea89bdbee258811 Apr 20 16:06:29 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:06:29 user devstack@n-api.service[61518]: method: > Apr 20 16:06:29 user devstack@n-api.service[61518]: exception: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:06:29 user devstack@n-api.service[61518]: action_args: {'id': 'e1036e0f-683f-4dfd-b0ad-6187d90ff2f6'} Apr 20 16:06:29 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:06:29 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:06:29 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Returning 404 to user: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:06:29 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-04978c3e-c2b7-4fd0-bc68-c447c9c7f42a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6" status: 404 len: 111 microversion: 2.1 time: 0.035560 Apr 20 16:06:29 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 64/188] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:29 2023] GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:06:29 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-1ba1787f-8777-4657-8a36-d55e3c9b8c7a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '.version_select at 0x7f5587b065f0>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:29 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:29 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:06:29 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-1ba1787f-8777-4657-8a36-d55e3c9b8c7a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058378220" status: 202 len: 0 microversion: 2.1 time: 0.024215 Apr 20 16:06:29 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 61/189] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 16:06:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058378220 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 16:06:30 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bc26ae9e-5832-40c5-b9fd-bbc1da88de6f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Action: 'create', calling method: .version_select at 0x7f5587ad7ac0>, body: {"keypair": {"name": "tempest-keypair-398342575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZM/GSdMLabrovqLAcYqsj7WFJ8JEyf+MdNfn+7QjGV1E8w98tErRtmHPGjmfT7XNg40a0X/HuPTbbuPZsBHAMaW5V6k6XIxdNK2JrY++eeL0UNW7ZwAqAXZ0rf7wYalg=="}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:30 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-bc26ae9e-5832-40c5-b9fd-bbc1da88de6f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for project 77f831070f5847bda788f6f0fcfedb03. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:06:30 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-bc26ae9e-5832-40c5-b9fd-bbc1da88de6f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for user 1c8f57b12bc749888ea89bdbee258811 and project 77f831070f5847bda788f6f0fcfedb03. Resources: {'key_pairs'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:06:30 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-bc26ae9e-5832-40c5-b9fd-bbc1da88de6f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052823 Apr 20 16:06:30 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 65/190] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:06:30 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:31 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:31 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-673629515", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "27275346-fa92-4114-a62b-d59f0212eb8f"}], "security_groups": [{"name": "tempest-securitygroup--1024516105"}], "key_name": "tempest-keypair-398342575", "user_data": "}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:31 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-24f22f30-31d1-47a3-95e5-07e3d4398e16 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a" status: 200 len: 1546 microversion: 2.1 time: 0.263670 Apr 20 16:06:31 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 65/191] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:31 2023] GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:31 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] validate_networks() for [('27275346-fa92-4114-a62b-d59f0212eb8f', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for project 77f831070f5847bda788f6f0fcfedb03. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Getting quotas for user 1c8f57b12bc749888ea89bdbee258811 and project 77f831070f5847bda788f6f0fcfedb03. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:06:32 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:06:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-efb822b5-9e82-4796-b1ec-680a0a3ad818 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.891307 Apr 20 16:06:32 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 62/192] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:06:31 2023] POST /compute/v2.1/servers => generated 400 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:06:32 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ac796bcb-ae82-49a0-bb7e-f296ae2299d9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:32 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-ac796bcb-ae82-49a0-bb7e-f296ae2299d9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:32 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-ac796bcb-ae82-49a0-bb7e-f296ae2299d9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8f57b12bc749888ea89bdbee258811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f831070f5847bda788f6f0fcfedb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:32 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ac796bcb-ae82-49a0-bb7e-f296ae2299d9 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f" status: 200 len: 1230 microversion: 2.1 time: 0.076377 Apr 20 16:06:32 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:32 2023] GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f => generated 1230 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:33 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:33 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-dc2fd5f2-7e1c-48f8-b660-b77a646f0dc6 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48" status: 200 len: 1584 microversion: 2.20 time: 0.243640 Apr 20 16:06:33 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 66/194] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:06:33 2023] GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 => generated 1584 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:34 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:06:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-002dcb00-027a-413f-942c-8a923cdef68a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412" status: 204 len: 0 microversion: 2.1 time: 0.123923 Apr 20 16:06:35 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 63/195] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:06:34 2023] DELETE /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:35 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-ebdfa73e-6cf3-4f2a-87c7-48b259c9100a req-eb7bf867-7eb5-4944-b063-09a8341e43f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd78d74a-11d6-4f06-8092-5088b3fad412", "name": "network-vif-unplugged", "status": "completed", "tag": "14dcc4ff-4a09-446a-b0ea-d9989cd3fa16"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:35 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-ebdfa73e-6cf3-4f2a-87c7-48b259c9100a req-eb7bf867-7eb5-4944-b063-09a8341e43f8 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:35 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-ebdfa73e-6cf3-4f2a-87c7-48b259c9100a req-eb7bf867-7eb5-4944-b063-09a8341e43f8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:35 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-ebdfa73e-6cf3-4f2a-87c7-48b259c9100a req-eb7bf867-7eb5-4944-b063-09a8341e43f8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:35 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-ebdfa73e-6cf3-4f2a-87c7-48b259c9100a req-eb7bf867-7eb5-4944-b063-09a8341e43f8 service nova] Creating event network-vif-unplugged:14dcc4ff-4a09-446a-b0ea-d9989cd3fa16 for instance dd78d74a-11d6-4f06-8092-5088b3fad412 on user Apr 20 16:06:35 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-ebdfa73e-6cf3-4f2a-87c7-48b259c9100a req-eb7bf867-7eb5-4944-b063-09a8341e43f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037358 Apr 20 16:06:35 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 67/196] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:35 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-b88a9552-41d8-4f79-a12e-9526b21a2e2c req-6b9a5286-9eeb-4577-aa90-e22196978386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac0a246-e2fe-4164-9bc1-c96bb94e396f", "tag": "64234034-3bc7-49ec-adb2-d425da7301e7"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b88a9552-41d8-4f79-a12e-9526b21a2e2c req-6b9a5286-9eeb-4577-aa90-e22196978386 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b88a9552-41d8-4f79-a12e-9526b21a2e2c req-6b9a5286-9eeb-4577-aa90-e22196978386 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b88a9552-41d8-4f79-a12e-9526b21a2e2c req-6b9a5286-9eeb-4577-aa90-e22196978386 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-b88a9552-41d8-4f79-a12e-9526b21a2e2c req-6b9a5286-9eeb-4577-aa90-e22196978386 service nova] Creating event network-changed:64234034-3bc7-49ec-adb2-d425da7301e7 for instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f on user Apr 20 16:06:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-b88a9552-41d8-4f79-a12e-9526b21a2e2c req-6b9a5286-9eeb-4577-aa90-e22196978386 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030327 Apr 20 16:06:35 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 64/197] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:35 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ef1044d6-1625-4754-b496-27e9c67232e2 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412" status: 200 len: 1500 microversion: 2.1 time: 0.395415 Apr 20 16:06:35 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:35 2023] GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 => generated 1500 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:37 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-af574e9b-172f-4247-8fe1-5c5b7a6c610d req-9f188fad-2c00-4cd7-8a9d-a92f6c9c517a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd78d74a-11d6-4f06-8092-5088b3fad412", "name": "network-vif-plugged", "status": "completed", "tag": "14dcc4ff-4a09-446a-b0ea-d9989cd3fa16"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-af574e9b-172f-4247-8fe1-5c5b7a6c610d req-9f188fad-2c00-4cd7-8a9d-a92f6c9c517a service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-af574e9b-172f-4247-8fe1-5c5b7a6c610d req-9f188fad-2c00-4cd7-8a9d-a92f6c9c517a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-af574e9b-172f-4247-8fe1-5c5b7a6c610d req-9f188fad-2c00-4cd7-8a9d-a92f6c9c517a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-af574e9b-172f-4247-8fe1-5c5b7a6c610d req-9f188fad-2c00-4cd7-8a9d-a92f6c9c517a service nova] Creating event network-vif-plugged:14dcc4ff-4a09-446a-b0ea-d9989cd3fa16 for instance dd78d74a-11d6-4f06-8092-5088b3fad412 on user Apr 20 16:06:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-af574e9b-172f-4247-8fe1-5c5b7a6c610d req-9f188fad-2c00-4cd7-8a9d-a92f6c9c517a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028964 Apr 20 16:06:37 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 68/199] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:37 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-8bd8b6b6-f070-440c-905c-39183171f47c req-337af847-f5c2-4e2f-a07e-03d6374d0890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd78d74a-11d6-4f06-8092-5088b3fad412", "name": "network-vif-deleted", "tag": "14dcc4ff-4a09-446a-b0ea-d9989cd3fa16"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8bd8b6b6-f070-440c-905c-39183171f47c req-337af847-f5c2-4e2f-a07e-03d6374d0890 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8bd8b6b6-f070-440c-905c-39183171f47c req-337af847-f5c2-4e2f-a07e-03d6374d0890 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:37 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8bd8b6b6-f070-440c-905c-39183171f47c req-337af847-f5c2-4e2f-a07e-03d6374d0890 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:37 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-8bd8b6b6-f070-440c-905c-39183171f47c req-337af847-f5c2-4e2f-a07e-03d6374d0890 service nova] Creating event network-vif-deleted:14dcc4ff-4a09-446a-b0ea-d9989cd3fa16 for instance dd78d74a-11d6-4f06-8092-5088b3fad412 on user Apr 20 16:06:37 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-8bd8b6b6-f070-440c-905c-39183171f47c req-337af847-f5c2-4e2f-a07e-03d6374d0890 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031191 Apr 20 16:06:37 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 65/200] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:37 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eeb9edc18f48f0ad13c819cdac9106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbcfeb5266f4ca6b9738b18ba7d127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:37 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-0c180697-6fa7-4502-9d3d-1fb090fa095c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81" status: 200 len: 1670 microversion: 2.1 time: 0.236798 Apr 20 16:06:37 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:37 2023] GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-77400feb-a13c-45cb-982b-9d8130aaa1a5 req-9c3d757e-412d-4862-bdd0-8af79e635821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac0a246-e2fe-4164-9bc1-c96bb94e396f", "name": "network-vif-plugged", "status": "completed", "tag": "64234034-3bc7-49ec-adb2-d425da7301e7"}, {"server_uuid": "3ac0a246-e2fe-4164-9bc1-c96bb94e396f", "name": "network-vif-plugged", "status": "completed", "tag": "64234034-3bc7-49ec-adb2-d425da7301e7"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-77400feb-a13c-45cb-982b-9d8130aaa1a5 req-9c3d757e-412d-4862-bdd0-8af79e635821 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-77400feb-a13c-45cb-982b-9d8130aaa1a5 req-9c3d757e-412d-4862-bdd0-8af79e635821 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-77400feb-a13c-45cb-982b-9d8130aaa1a5 req-9c3d757e-412d-4862-bdd0-8af79e635821 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:39 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-77400feb-a13c-45cb-982b-9d8130aaa1a5 req-9c3d757e-412d-4862-bdd0-8af79e635821 service nova] Creating event network-vif-plugged:64234034-3bc7-49ec-adb2-d425da7301e7 for instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f on user Apr 20 16:06:39 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-77400feb-a13c-45cb-982b-9d8130aaa1a5 req-9c3d757e-412d-4862-bdd0-8af79e635821 service nova] Creating event network-vif-plugged:64234034-3bc7-49ec-adb2-d425da7301e7 for instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f on user Apr 20 16:06:39 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-77400feb-a13c-45cb-982b-9d8130aaa1a5 req-9c3d757e-412d-4862-bdd0-8af79e635821 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028661 Apr 20 16:06:39 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 69/202] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-baf124ed-45ce-4c06-8b40-3ebfd2fd356f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '.version_select at 0x7f5587b04040>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:39 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-baf124ed-45ce-4c06-8b40-3ebfd2fd356f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91" status: 204 len: 0 microversion: 2.1 time: 0.197864 Apr 20 16:06:39 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 66/203] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:39 2023] DELETE /compute/v2.1/images/2fdf9d5e-3bf1-4eb7-b479-5863e7de3f91 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:39 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:06:39 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-bbaf9613-e938-40f8-933e-790c0a707355 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81" status: 204 len: 0 microversion: 2.1 time: 0.115258 Apr 20 16:06:39 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 69/204] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:06:39 2023] DELETE /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: a145fb51-4ca5-4cc4-b8bd-cd3665bef473] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:40 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eeb9edc18f48f0ad13c819cdac9106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbcfeb5266f4ca6b9738b18ba7d127e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:40 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-7fdc60c9-425b-40a9-bd39-b53db0d55e8f tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81" status: 200 len: 1676 microversion: 2.1 time: 0.295894 Apr 20 16:06:40 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 70/205] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:39 2023] GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 => generated 1676 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:40 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92692a1d38b4531a4e7f42660a54c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92cea9e1182477ca669c506b42eda60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:40 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-41a79829-3203-428b-87d1-76422c0d2961 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473" status: 200 len: 1496 microversion: 2.1 time: 0.268827 Apr 20 16:06:40 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 67/206] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:39 2023] GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473 => generated 1496 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:40 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:41 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:06:41 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-30caee76-5725-4ed7-af9a-f6ce506cca82 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1539 microversion: 2.1 time: 0.475567 Apr 20 16:06:41 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:06:40 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1539 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:06:41 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-000593b0-9600-423d-956b-b3e47c2309d4 req-664e3ab0-2a8b-4d71-bdc5-d327ab95148f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f4b3d1-0fea-4378-94e3-c2bbfd8cad81", "name": "network-vif-unplugged", "status": "completed", "tag": "b2af67f0-0768-4ebc-a21b-0ef6e2b3f264"}, {"server_uuid": "91f4b3d1-0fea-4378-94e3-c2bbfd8cad81", "name": "network-vif-plugged", "status": "completed", "tag": "b2af67f0-0768-4ebc-a21b-0ef6e2b3f264"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-000593b0-9600-423d-956b-b3e47c2309d4 req-664e3ab0-2a8b-4d71-bdc5-d327ab95148f service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-000593b0-9600-423d-956b-b3e47c2309d4 req-664e3ab0-2a8b-4d71-bdc5-d327ab95148f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-000593b0-9600-423d-956b-b3e47c2309d4 req-664e3ab0-2a8b-4d71-bdc5-d327ab95148f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:41 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-000593b0-9600-423d-956b-b3e47c2309d4 req-664e3ab0-2a8b-4d71-bdc5-d327ab95148f service nova] Creating event network-vif-unplugged:b2af67f0-0768-4ebc-a21b-0ef6e2b3f264 for instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 on user Apr 20 16:06:41 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-000593b0-9600-423d-956b-b3e47c2309d4 req-664e3ab0-2a8b-4d71-bdc5-d327ab95148f service nova] Creating event network-vif-plugged:b2af67f0-0768-4ebc-a21b-0ef6e2b3f264 for instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 on user Apr 20 16:06:41 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-000593b0-9600-423d-956b-b3e47c2309d4 req-664e3ab0-2a8b-4d71-bdc5-d327ab95148f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034214 Apr 20 16:06:41 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 71/208] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:06:41 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-c8923aa7-a477-4917-9b0b-3d04070ec9a2 req-151d7144-a237-409f-9d9d-f703d8782726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f4b3d1-0fea-4378-94e3-c2bbfd8cad81", "name": "network-vif-deleted", "tag": "b2af67f0-0768-4ebc-a21b-0ef6e2b3f264"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:06:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-c8923aa7-a477-4917-9b0b-3d04070ec9a2 req-151d7144-a237-409f-9d9d-f703d8782726 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:06:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-c8923aa7-a477-4917-9b0b-3d04070ec9a2 req-151d7144-a237-409f-9d9d-f703d8782726 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:06:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-c8923aa7-a477-4917-9b0b-3d04070ec9a2 req-151d7144-a237-409f-9d9d-f703d8782726 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:06:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-c8923aa7-a477-4917-9b0b-3d04070ec9a2 req-151d7144-a237-409f-9d9d-f703d8782726 service nova] Creating event network-vif-deleted:b2af67f0-0768-4ebc-a21b-0ef6e2b3f264 for instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 on user Apr 20 16:06:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-c8923aa7-a477-4917-9b0b-3d04070ec9a2 req-151d7144-a237-409f-9d9d-f703d8782726 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034936 Apr 20 16:06:41 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 68/209] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:23 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8f57b12bc749888ea89bdbee258811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f831070f5847bda788f6f0fcfedb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:23 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-3bed2b98-b425-4cee-8e8a-486a3dba1144 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f" status: 200 len: 1535 microversion: 2.1 time: 0.271982 Apr 20 16:07:23 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:22 2023] GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f => generated 1535 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=17 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=28 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:25 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] HTTP exception thrown: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Request method failure captured: Apr 20 16:07:25 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 HTTP/1.1 Apr 20 16:07:25 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:07:25 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:07:25 user devstack@n-api.service[61518]: Connection: close Apr 20 16:07:25 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:07:25 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:07:25 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:07:25 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:07:25 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWIo2AFjK9eG4FPXNdvM7y0w3rHXpMDlETareP11qxnPua6l_xiHs5DzHRs39K90LFzTFqjvXY4iKpqzOLJYu9wD6xWpNrsUwm_bIjhDnH_11gcZ7hRm6cvcbD1a7qB4AbXDd9As6VYAZGCDAsbjrCryi7-2_EWtm-x3Ll0cghRYSx8 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Project-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Project-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Tenant: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Tenant-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-User: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:07:25 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:07:25 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:07:25 user devstack@n-api.service[61518]: X-User-Id: 9be25e958c6047068ab5ce63106b0754 Apr 20 16:07:25 user devstack@n-api.service[61518]: X-User-Name: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:07:25 user devstack@n-api.service[61518]: method: > Apr 20 16:07:25 user devstack@n-api.service[61518]: exception: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:07:25 user devstack@n-api.service[61518]: action_args: {'id': 'dd78d74a-11d6-4f06-8092-5088b3fad412'} Apr 20 16:07:25 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:07:25 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:25 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Returning 404 to user: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:07:25 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-201e99cb-7df9-4242-896d-038cf7ccba4a tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412" status: 404 len: 111 microversion: 2.1 time: 0.036557 Apr 20 16:07:25 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 72/211] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:25 2023] GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:25 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:25 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-c0ce486c-4382-461f-a677-ba5db7287267 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 200 len: 1494 microversion: 2.1 time: 0.233044 Apr 20 16:07:25 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 69/212] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:25 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 1494 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: e8f62d46-e2dc-4870-adf1-f62d88bb653b] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:29 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:29 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-4de1e940-0536-414a-9900-575945db2776 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b" status: 200 len: 1504 microversion: 2.1 time: 0.219629 Apr 20 16:07:29 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 72/213] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:29 2023] GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] [instance: 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:30 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] HTTP exception thrown: Instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 could not be found. Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Request method failure captured: Apr 20 16:07:30 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 HTTP/1.1 Apr 20 16:07:30 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:07:30 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:07:30 user devstack@n-api.service[61518]: Connection: close Apr 20 16:07:30 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:07:30 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:07:30 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:07:30 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:07:30 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWIkgIxA6XqAErz4tq_UVQ65nhETvZyTLy5tU2syti3s62dDAJttXHzAcCk6-AAoOdRyIgbF97BlaDe-x2qM1kQnM4lyLH4g5LAaYFXOguWuHoor_lhZF29J81K53rIvrixTkKyXx7Dpb9TbM_xWWqN5iJYnVAhKyTrH7SpFC2BUfXo Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Project-Id: fbbcfeb5266f4ca6b9738b18ba7d127e Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Project-Name: tempest-ServerStableDeviceRescueTest-179851846 Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbbcfeb5266f4ca6b9738b18ba7d127e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbbcfeb5266f4ca6b9738b18ba7d127e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbbcfeb5266f4ca6b9738b18ba7d127e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Tenant: tempest-ServerStableDeviceRescueTest-179851846 Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Tenant-Id: fbbcfeb5266f4ca6b9738b18ba7d127e Apr 20 16:07:30 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-179851846 Apr 20 16:07:30 user devstack@n-api.service[61518]: X-User: tempest-ServerStableDeviceRescueTest-179851846-project-member Apr 20 16:07:30 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:07:30 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:07:30 user devstack@n-api.service[61518]: X-User-Id: 48eeb9edc18f48f0ad13c819cdac9106 Apr 20 16:07:30 user devstack@n-api.service[61518]: X-User-Name: tempest-ServerStableDeviceRescueTest-179851846-project-member Apr 20 16:07:30 user devstack@n-api.service[61518]: method: > Apr 20 16:07:30 user devstack@n-api.service[61518]: exception: Instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 could not be found. Apr 20 16:07:30 user devstack@n-api.service[61518]: action_args: {'id': '91f4b3d1-0fea-4378-94e3-c2bbfd8cad81'} Apr 20 16:07:30 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 could not be found. Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 could not be found. Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 could not be found. Apr 20 16:07:30 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:07:30 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Returning 404 to user: Instance 91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:07:30 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-1729c7e1-2887-4100-a2b7-5ea1b9ccd72c tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81" status: 404 len: 111 microversion: 2.1 time: 0.028681 Apr 20 16:07:30 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 73/214] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:30 2023] GET /compute/v2.1/servers/91f4b3d1-0fea-4378-94e3-c2bbfd8cad81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:07:30 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-80f44e78-14ac-484f-a474-3932621ecc91 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] Calling method '.version_select at 0x7f5587b7f250>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:30 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-80f44e78-14ac-484f-a474-3932621ecc91 tempest-ServerStableDeviceRescueTest-179851846 tempest-ServerStableDeviceRescueTest-179851846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58929071" status: 202 len: 0 microversion: 2.1 time: 0.022680 Apr 20 16:07:30 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 70/215] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 16:07:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58929071 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:32 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-d32b1178-2d66-4826-92b6-82f0d84da141 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.170802 Apr 20 16:07:32 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:07:31 2023] GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a/os-interface => generated 283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:32 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-5ae99e58-4429-4703-822e-3fd559188962 req-b9937401-bdc1-4695-b021-c6b70f63b5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b84ca2-f67b-4219-b7e6-18d2029e998a", "tag": "9e814c79-86f6-46ce-9473-d87fb7e67641"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-5ae99e58-4429-4703-822e-3fd559188962 req-b9937401-bdc1-4695-b021-c6b70f63b5e6 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-5ae99e58-4429-4703-822e-3fd559188962 req-b9937401-bdc1-4695-b021-c6b70f63b5e6 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-5ae99e58-4429-4703-822e-3fd559188962 req-b9937401-bdc1-4695-b021-c6b70f63b5e6 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:32 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-5ae99e58-4429-4703-822e-3fd559188962 req-b9937401-bdc1-4695-b021-c6b70f63b5e6 service nova] Creating event network-changed:9e814c79-86f6-46ce-9473-d87fb7e67641 for instance c2b84ca2-f67b-4219-b7e6-18d2029e998a on user Apr 20 16:07:32 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-5ae99e58-4429-4703-822e-3fd559188962 req-b9937401-bdc1-4695-b021-c6b70f63b5e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030739 Apr 20 16:07:32 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 74/217] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-717768d5-e183-4587-a400-7ed5bdfad279 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a/ips" status: 200 len: 108 microversion: 2.1 time: 0.036343 Apr 20 16:07:32 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 71/218] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:07:32 2023] GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:33 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:34 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-925c5007-b946-4caa-a3e5-870a2ce3168f tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.154442 Apr 20 16:07:34 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 74/219] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 16:07:33 2023] GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48/os-interface => generated 282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:34 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:07:34 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-86905471-bdaa-483d-bf8a-62aba094cbca tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a" status: 204 len: 0 microversion: 2.1 time: 0.126604 Apr 20 16:07:34 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 75/220] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:07:34 2023] DELETE /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:34 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:34 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-27e7ae56-da23-4685-a666-b3391a6f9514 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a" status: 200 len: 1670 microversion: 2.1 time: 0.238522 Apr 20 16:07:34 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 72/221] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:34 2023] GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a => generated 1670 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-988efc28-1879-4161-8fff-25a792c55ed0 req-31acc249-6a46-4177-8e57-e9f573db05ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b84ca2-f67b-4219-b7e6-18d2029e998a", "name": "network-vif-unplugged", "status": "completed", "tag": "9e814c79-86f6-46ce-9473-d87fb7e67641"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-988efc28-1879-4161-8fff-25a792c55ed0 req-31acc249-6a46-4177-8e57-e9f573db05ee service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-988efc28-1879-4161-8fff-25a792c55ed0 req-31acc249-6a46-4177-8e57-e9f573db05ee service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-988efc28-1879-4161-8fff-25a792c55ed0 req-31acc249-6a46-4177-8e57-e9f573db05ee service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:34 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-988efc28-1879-4161-8fff-25a792c55ed0 req-31acc249-6a46-4177-8e57-e9f573db05ee service nova] Creating event network-vif-unplugged:9e814c79-86f6-46ce-9473-d87fb7e67641 for instance c2b84ca2-f67b-4219-b7e6-18d2029e998a on user Apr 20 16:07:34 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-988efc28-1879-4161-8fff-25a792c55ed0 req-31acc249-6a46-4177-8e57-e9f573db05ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032282 Apr 20 16:07:34 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 75/222] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:35 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-c50b329e-0855-445d-83fb-5459e5dd58b4 req-d1ab1c53-96f6-44d2-8883-156df888f0eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a760987f-1a65-4e42-8cef-73db9ef2db48", "tag": "cac4dfaa-510a-4330-b9b1-aeb25f57abef"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:35 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-c50b329e-0855-445d-83fb-5459e5dd58b4 req-d1ab1c53-96f6-44d2-8883-156df888f0eb service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:35 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-c50b329e-0855-445d-83fb-5459e5dd58b4 req-d1ab1c53-96f6-44d2-8883-156df888f0eb service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:35 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-c50b329e-0855-445d-83fb-5459e5dd58b4 req-d1ab1c53-96f6-44d2-8883-156df888f0eb service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:35 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-c50b329e-0855-445d-83fb-5459e5dd58b4 req-d1ab1c53-96f6-44d2-8883-156df888f0eb service nova] Creating event network-changed:cac4dfaa-510a-4330-b9b1-aeb25f57abef for instance a760987f-1a65-4e42-8cef-73db9ef2db48 on user Apr 20 16:07:35 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-c50b329e-0855-445d-83fb-5459e5dd58b4 req-d1ab1c53-96f6-44d2-8883-156df888f0eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030710 Apr 20 16:07:35 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 76/223] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-0a2e64f7-5216-4e08-af0c-1e81d5c4af9c tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48/ips" status: 200 len: 110 microversion: 2.20 time: 0.040950 Apr 20 16:07:35 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 73/224] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 16:07:35 2023] GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48/ips => generated 110 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 16:07:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-2d6996d1-6c99-4e32-bc69-5ba1af8a9e45 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] Action: 'create', calling method: .version_select at 0x7f5587ad7f40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1992717218"}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-2d6996d1-6c99-4e32-bc69-5ba1af8a9e45 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.538714 Apr 20 16:07:35 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 76/225] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 20 16:07:35 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 540 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 16:07:35 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e0173074-6542-4b31-abf5-fa17c64a1181 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] Calling method '.version_select at 0x7f5587b84e50>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:35 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e0173074-6542-4b31-abf5-fa17c64a1181 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039" status: 200 len: 342 microversion: 2.1 time: 0.073411 Apr 20 16:07:35 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 16:07:35 2023] GET /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039 => generated 342 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:07:36 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-30cd85b0-a565-45ca-84c7-9c17eb92fc4e tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] Calling method '.version_select at 0x7f5587a6c940>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:36 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-c2e831f2-a9c6-43e1-a22e-5a7582a49c42 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48" status: 204 len: 0 microversion: 2.20 time: 0.113450 Apr 20 16:07:36 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 74/227] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:07:36 2023] DELETE /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-30cd85b0-a565-45ca-84c7-9c17eb92fc4e tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039" status: 200 len: 342 microversion: 2.1 time: 0.055024 Apr 20 16:07:36 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 16:07:36 2023] GET /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039 => generated 342 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:36 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-f4222fcf-27c9-4721-8f0f-9c3587adfd67 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] Calling method '.version_select at 0x7f5587b7f2e0>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:36 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-92d782e9-21ff-4ad5-802d-8ba4c93e26cd req-cbbba103-61c1-4a9f-828a-a9873909bca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b84ca2-f67b-4219-b7e6-18d2029e998a", "name": "network-vif-plugged", "status": "completed", "tag": "9e814c79-86f6-46ce-9473-d87fb7e67641"}, {"server_uuid": "c2b84ca2-f67b-4219-b7e6-18d2029e998a", "name": "network-vif-deleted", "tag": "9e814c79-86f6-46ce-9473-d87fb7e67641"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-92d782e9-21ff-4ad5-802d-8ba4c93e26cd req-cbbba103-61c1-4a9f-828a-a9873909bca2 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-92d782e9-21ff-4ad5-802d-8ba4c93e26cd req-cbbba103-61c1-4a9f-828a-a9873909bca2 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-92d782e9-21ff-4ad5-802d-8ba4c93e26cd req-cbbba103-61c1-4a9f-828a-a9873909bca2 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-92d782e9-21ff-4ad5-802d-8ba4c93e26cd req-cbbba103-61c1-4a9f-828a-a9873909bca2 service nova] Creating event network-vif-plugged:9e814c79-86f6-46ce-9473-d87fb7e67641 for instance c2b84ca2-f67b-4219-b7e6-18d2029e998a on user Apr 20 16:07:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-92d782e9-21ff-4ad5-802d-8ba4c93e26cd req-cbbba103-61c1-4a9f-828a-a9873909bca2 service nova] Creating event network-vif-deleted:9e814c79-86f6-46ce-9473-d87fb7e67641 for instance c2b84ca2-f67b-4219-b7e6-18d2029e998a on user Apr 20 16:07:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-92d782e9-21ff-4ad5-802d-8ba4c93e26cd req-cbbba103-61c1-4a9f-828a-a9873909bca2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034850 Apr 20 16:07:36 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 78/229] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:37 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-f4222fcf-27c9-4721-8f0f-9c3587adfd67 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039" status: 202 len: 0 microversion: 2.1 time: 0.162299 Apr 20 16:07:37 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 75/230] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:07:36 2023] DELETE /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:07:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-fe62715a-2275-43c5-b8ae-3b93e1f530e3 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] Calling method '.version_select at 0x7f55879f3760>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:37 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-fe62715a-2275-43c5-b8ae-3b93e1f530e3 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] HTTP exception thrown: Volume 6da3204e-d1a6-4579-a7c9-a128602f6039 could not be found. Apr 20 16:07:37 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-fe62715a-2275-43c5-b8ae-3b93e1f530e3 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] Request method failure captured: Apr 20 16:07:37 user devstack@n-api.service[61517]: request: GET /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039 HTTP/1.1 Apr 20 16:07:37 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:07:37 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:07:37 user devstack@n-api.service[61517]: Connection: close Apr 20 16:07:37 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:07:37 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:07:37 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:07:37 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:07:37 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWNHpCIJFEU_VDvdo2NXayk0cOQUbfEcBU5DeboPdKiSR5eYUJS9U-sl8SklVYubfS6FRGqgEuxucXHTGFuDpsPk6c01_FiEH19gBLCrJ10pucTezf-dnBAVeugMA7Qzh6CMjg96wMFH3SJtSOqYh9Q9eotZKfOi33dnoQtJDez1ytw Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Project-Id: 3464ecedeba14ddca6c6cec14a013116 Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1250161246 Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3464ecedeba14ddca6c6cec14a013116"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3464ecedeba14ddca6c6cec14a013116"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3464ecedeba14ddca6c6cec14a013116"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1250161246 Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Tenant-Id: 3464ecedeba14ddca6c6cec14a013116 Apr 20 16:07:37 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1250161246 Apr 20 16:07:37 user devstack@n-api.service[61517]: X-User: tempest-VolumesSnapshotsTestJSON-1250161246-project-member Apr 20 16:07:37 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:07:37 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:07:37 user devstack@n-api.service[61517]: X-User-Id: 6660d218e14a4f8f86c34ffaff6d8985 Apr 20 16:07:37 user devstack@n-api.service[61517]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1250161246-project-member Apr 20 16:07:37 user devstack@n-api.service[61517]: method: Apr 20 16:07:37 user devstack@n-api.service[61517]: exception: Volume 6da3204e-d1a6-4579-a7c9-a128602f6039 could not be found. Apr 20 16:07:37 user devstack@n-api.service[61517]: action_args: {'id': '6da3204e-d1a6-4579-a7c9-a128602f6039'} Apr 20 16:07:37 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6da3204e-d1a6-4579-a7c9-a128602f6039 could not be found. (HTTP 404) (Request-ID: req-b9b57eaa-4f51-4181-91ca-59f8b1373fa4) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6da3204e-d1a6-4579-a7c9-a128602f6039 could not be found. Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6da3204e-d1a6-4579-a7c9-a128602f6039 could not be found. Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6da3204e-d1a6-4579-a7c9-a128602f6039 could not be found. Apr 20 16:07:37 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:07:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-fe62715a-2275-43c5-b8ae-3b93e1f530e3 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] Returning 404 to user: Volume 6da3204e-d1a6-4579-a7c9-a128602f6039 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:07:37 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-fe62715a-2275-43c5-b8ae-3b93e1f530e3 tempest-VolumesSnapshotsTestJSON-1250161246 tempest-VolumesSnapshotsTestJSON-1250161246-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039" status: 404 len: 109 microversion: 2.1 time: 0.045429 Apr 20 16:07:37 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 16:07:37 2023] GET /compute/v2.1/os-volumes/6da3204e-d1a6-4579-a7c9-a128602f6039 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:07:37 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:37 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50dbce30f294bb0ba6bc2811025835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0a5eb3796a4d3a871843f409c6ffbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-025c9b6d-32bf-4b6c-ac17-f126a32c0038 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48" status: 200 len: 1709 microversion: 2.20 time: 0.247407 Apr 20 16:07:37 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 78/232] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:07:36 2023] GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 => generated 1709 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:07:38 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a760987f-1a65-4e42-8cef-73db9ef2db48", "name": "network-vif-unplugged", "status": "completed", "tag": "cac4dfaa-510a-4330-b9b1-aeb25f57abef"}, {"server_uuid": "a760987f-1a65-4e42-8cef-73db9ef2db48", "name": "network-vif-plugged", "status": "completed", "tag": "cac4dfaa-510a-4330-b9b1-aeb25f57abef"}, {"server_uuid": "a760987f-1a65-4e42-8cef-73db9ef2db48", "name": "network-vif-deleted", "tag": "cac4dfaa-510a-4330-b9b1-aeb25f57abef"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:39 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] Creating event network-vif-unplugged:cac4dfaa-510a-4330-b9b1-aeb25f57abef for instance a760987f-1a65-4e42-8cef-73db9ef2db48 on user Apr 20 16:07:39 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] Creating event network-vif-plugged:cac4dfaa-510a-4330-b9b1-aeb25f57abef for instance a760987f-1a65-4e42-8cef-73db9ef2db48 on user Apr 20 16:07:39 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] Creating event network-vif-deleted:cac4dfaa-510a-4330-b9b1-aeb25f57abef for instance a760987f-1a65-4e42-8cef-73db9ef2db48 on user Apr 20 16:07:39 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-65160bf0-588a-407d-ac76-974155d4a759 req-67601db3-8e54-4f13-88aa-248352f756ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.029368 Apr 20 16:07:39 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 76/233] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:38 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:41 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:41 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-e19602d5-4461-465b-8dfc-e4a62764efa2 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184967 Apr 20 16:07:41 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 80/234] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:07:41 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7/os-interface => generated 282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: a145fb51-4ca5-4cc4-b8bd-cd3665bef473] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:41 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: a145fb51-4ca5-4cc4-b8bd-cd3665bef473] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:07:42 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-453e3070-d61a-46f9-8e30-0d71853f9e2d tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473" status: 204 len: 0 microversion: 2.1 time: 0.173933 Apr 20 16:07:42 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:07:41 2023] DELETE /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: a145fb51-4ca5-4cc4-b8bd-cd3665bef473] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-1437160b-a3c4-47e3-8457-d035ccca5842 req-b6f1c217-85c0-4b6a-bcdf-0f107f752fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a145fb51-4ca5-4cc4-b8bd-cd3665bef473", "name": "network-vif-unplugged", "status": "completed", "tag": "989ee5cd-ff10-4bcc-9b11-017b23299187"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1437160b-a3c4-47e3-8457-d035ccca5842 req-b6f1c217-85c0-4b6a-bcdf-0f107f752fc0 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1437160b-a3c4-47e3-8457-d035ccca5842 req-b6f1c217-85c0-4b6a-bcdf-0f107f752fc0 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1437160b-a3c4-47e3-8457-d035ccca5842 req-b6f1c217-85c0-4b6a-bcdf-0f107f752fc0 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-1437160b-a3c4-47e3-8457-d035ccca5842 req-b6f1c217-85c0-4b6a-bcdf-0f107f752fc0 service nova] Creating event network-vif-unplugged:989ee5cd-ff10-4bcc-9b11-017b23299187 for instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 on user Apr 20 16:07:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-1437160b-a3c4-47e3-8457-d035ccca5842 req-b6f1c217-85c0-4b6a-bcdf-0f107f752fc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031444 Apr 20 16:07:42 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 81/236] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92692a1d38b4531a4e7f42660a54c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92cea9e1182477ca669c506b42eda60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:42 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-dd2b6c93-4170-4102-937e-9a60c5687834 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473" status: 200 len: 1502 microversion: 2.1 time: 0.476099 Apr 20 16:07:42 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 77/237] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:42 2023] GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473 => generated 1502 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:42 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-855c0ac5-d780-4a66-989e-b222977f642c req-22afe9b2-96fd-487c-bbe8-5c18206f39a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d42ba7-cf47-4374-83b5-06d5242951b7", "tag": "e068d7e5-dc70-4b18-8dd6-5726f7a3bc84"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-855c0ac5-d780-4a66-989e-b222977f642c req-22afe9b2-96fd-487c-bbe8-5c18206f39a6 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-855c0ac5-d780-4a66-989e-b222977f642c req-22afe9b2-96fd-487c-bbe8-5c18206f39a6 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-855c0ac5-d780-4a66-989e-b222977f642c req-22afe9b2-96fd-487c-bbe8-5c18206f39a6 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:42 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-855c0ac5-d780-4a66-989e-b222977f642c req-22afe9b2-96fd-487c-bbe8-5c18206f39a6 service nova] Creating event network-changed:e068d7e5-dc70-4b18-8dd6-5726f7a3bc84 for instance 15d42ba7-cf47-4374-83b5-06d5242951b7 on user Apr 20 16:07:42 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-855c0ac5-d780-4a66-989e-b222977f642c req-22afe9b2-96fd-487c-bbe8-5c18206f39a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059287 Apr 20 16:07:42 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:42 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-9975411e-9f86-4fe1-a146-47b3eeaa742e tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1539 microversion: 2.1 time: 0.260606 Apr 20 16:07:42 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 82/239] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:42 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:43 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-f3cb4420-f971-4367-bbff-bc3cac7ba506 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1539 microversion: 2.1 time: 0.329034 Apr 20 16:07:43 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 78/240] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:42 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1539 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:44 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-c7d76e99-dcbe-46e0-a5da-6fb4f864ef7e req-b0f27748-4f41-4d72-a145-e6b3093f39ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a145fb51-4ca5-4cc4-b8bd-cd3665bef473", "name": "network-vif-plugged", "status": "completed", "tag": "989ee5cd-ff10-4bcc-9b11-017b23299187"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-c7d76e99-dcbe-46e0-a5da-6fb4f864ef7e req-b0f27748-4f41-4d72-a145-e6b3093f39ac service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-c7d76e99-dcbe-46e0-a5da-6fb4f864ef7e req-b0f27748-4f41-4d72-a145-e6b3093f39ac service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:44 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-c7d76e99-dcbe-46e0-a5da-6fb4f864ef7e req-b0f27748-4f41-4d72-a145-e6b3093f39ac service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:44 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-c7d76e99-dcbe-46e0-a5da-6fb4f864ef7e req-b0f27748-4f41-4d72-a145-e6b3093f39ac service nova] Creating event network-vif-plugged:989ee5cd-ff10-4bcc-9b11-017b23299187 for instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 on user Apr 20 16:07:44 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-c7d76e99-dcbe-46e0-a5da-6fb4f864ef7e req-b0f27748-4f41-4d72-a145-e6b3093f39ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030189 Apr 20 16:07:44 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:44 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-a0a32b64-2304-42f1-a466-e415c81d4204 req-26b682dd-3603-40c6-b642-2079221e63da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a145fb51-4ca5-4cc4-b8bd-cd3665bef473", "name": "network-vif-deleted", "tag": "989ee5cd-ff10-4bcc-9b11-017b23299187"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a0a32b64-2304-42f1-a466-e415c81d4204 req-26b682dd-3603-40c6-b642-2079221e63da service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a0a32b64-2304-42f1-a466-e415c81d4204 req-26b682dd-3603-40c6-b642-2079221e63da service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:44 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a0a32b64-2304-42f1-a466-e415c81d4204 req-26b682dd-3603-40c6-b642-2079221e63da service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-a0a32b64-2304-42f1-a466-e415c81d4204 req-26b682dd-3603-40c6-b642-2079221e63da service nova] Creating event network-vif-deleted:989ee5cd-ff10-4bcc-9b11-017b23299187 for instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 on user Apr 20 16:07:44 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-a0a32b64-2304-42f1-a466-e415c81d4204 req-26b682dd-3603-40c6-b642-2079221e63da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Apr 20 16:07:44 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 83/242] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:52 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-884360922", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "6deca2c3-6467-44e2-aa30-6cf5abf230f5"}]}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:52 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] validate_networks() for [('6deca2c3-6467-44e2-aa30-6cf5abf230f5', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Getting quotas for project ec92faae7a5d40f98409e9634a9dbf9b. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Getting quotas for user 403bee038ece4e9aa023aad83ee8f188 and project ec92faae7a5d40f98409e9634a9dbf9b. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:07:53 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] [instance: 4f841186-7958-4642-9050-9b048b61ebbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:07:53 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-80667c4e-636a-47b0-9f62-145495d3867d tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.840729 Apr 20 16:07:53 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 79/243] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:07:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:07:53 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f7f5ed04-4fd7-475e-b9c2-480f4073dcd3 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:07:53 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-f7f5ed04-4fd7-475e-b9c2-480f4073dcd3 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] [instance: 4f841186-7958-4642-9050-9b048b61ebbb] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:07:53 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-f7f5ed04-4fd7-475e-b9c2-480f4073dcd3 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403bee038ece4e9aa023aad83ee8f188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92faae7a5d40f98409e9634a9dbf9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:07:53 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-f7f5ed04-4fd7-475e-b9c2-480f4073dcd3 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb" status: 200 len: 1207 microversion: 2.1 time: 0.130714 Apr 20 16:07:53 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:07:53 2023] GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb => generated 1207 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:07:55 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=20 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:55 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=38 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:55 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-22de1b86-9c7f-4b6c-a245-57d32e3d20bd req-c63d848e-7428-407a-8b03-59d1deb3d648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f841186-7958-4642-9050-9b048b61ebbb", "tag": "fe7ac99b-2b51-4ae2-9903-9ae286328c8b"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-22de1b86-9c7f-4b6c-a245-57d32e3d20bd req-c63d848e-7428-407a-8b03-59d1deb3d648 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-22de1b86-9c7f-4b6c-a245-57d32e3d20bd req-c63d848e-7428-407a-8b03-59d1deb3d648 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:55 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-22de1b86-9c7f-4b6c-a245-57d32e3d20bd req-c63d848e-7428-407a-8b03-59d1deb3d648 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:55 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-22de1b86-9c7f-4b6c-a245-57d32e3d20bd req-c63d848e-7428-407a-8b03-59d1deb3d648 service nova] Creating event network-changed:fe7ac99b-2b51-4ae2-9903-9ae286328c8b for instance 4f841186-7958-4642-9050-9b048b61ebbb on user Apr 20 16:07:55 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-22de1b86-9c7f-4b6c-a245-57d32e3d20bd req-c63d848e-7428-407a-8b03-59d1deb3d648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Apr 20 16:07:55 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 84/245] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:07:58 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-90534178-4d34-498f-8f26-4545095b6ff7 req-50a7f591-30b6-49eb-a6d1-6aa55ced25be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f841186-7958-4642-9050-9b048b61ebbb", "name": "network-vif-plugged", "status": "completed", "tag": "fe7ac99b-2b51-4ae2-9903-9ae286328c8b"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:07:58 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:58 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-90534178-4d34-498f-8f26-4545095b6ff7 req-50a7f591-30b6-49eb-a6d1-6aa55ced25be service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:07:58 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-90534178-4d34-498f-8f26-4545095b6ff7 req-50a7f591-30b6-49eb-a6d1-6aa55ced25be service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:07:58 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-90534178-4d34-498f-8f26-4545095b6ff7 req-50a7f591-30b6-49eb-a6d1-6aa55ced25be service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:07:58 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:07:58 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-90534178-4d34-498f-8f26-4545095b6ff7 req-50a7f591-30b6-49eb-a6d1-6aa55ced25be service nova] Creating event network-vif-plugged:fe7ac99b-2b51-4ae2-9903-9ae286328c8b for instance 4f841186-7958-4642-9050-9b048b61ebbb on user Apr 20 16:07:58 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-90534178-4d34-498f-8f26-4545095b6ff7 req-50a7f591-30b6-49eb-a6d1-6aa55ced25be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038302 Apr 20 16:07:58 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 80/246] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:07:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:00 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:00 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-629a15ab-525f-4620-af7c-486edbc11782 req-31a62902-b507-462e-9be5-c99fba986b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f841186-7958-4642-9050-9b048b61ebbb", "name": "network-vif-plugged", "status": "completed", "tag": "fe7ac99b-2b51-4ae2-9903-9ae286328c8b"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:00 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:00 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-629a15ab-525f-4620-af7c-486edbc11782 req-31a62902-b507-462e-9be5-c99fba986b3d service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:00 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-629a15ab-525f-4620-af7c-486edbc11782 req-31a62902-b507-462e-9be5-c99fba986b3d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:00 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-629a15ab-525f-4620-af7c-486edbc11782 req-31a62902-b507-462e-9be5-c99fba986b3d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:00 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-629a15ab-525f-4620-af7c-486edbc11782 req-31a62902-b507-462e-9be5-c99fba986b3d service nova] Creating event network-vif-plugged:fe7ac99b-2b51-4ae2-9903-9ae286328c8b for instance 4f841186-7958-4642-9050-9b048b61ebbb on user Apr 20 16:08:00 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-629a15ab-525f-4620-af7c-486edbc11782 req-31a62902-b507-462e-9be5-c99fba986b3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088193 Apr 20 16:08:00 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 83/247] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:23 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-7a058713-8e79-4342-8780-77103b420d4d tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.227834 Apr 20 16:08:23 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 85/248] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:08:23 2023] GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f/os-interface => generated 282 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-9a17c8ef-99d5-46c8-936c-679340b0c68e req-9f891d1b-fc61-4b6c-adf7-2b01a8e41b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac0a246-e2fe-4164-9bc1-c96bb94e396f", "tag": "64234034-3bc7-49ec-adb2-d425da7301e7"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-9a17c8ef-99d5-46c8-936c-679340b0c68e req-9f891d1b-fc61-4b6c-adf7-2b01a8e41b9d service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-9a17c8ef-99d5-46c8-936c-679340b0c68e req-9f891d1b-fc61-4b6c-adf7-2b01a8e41b9d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-9a17c8ef-99d5-46c8-936c-679340b0c68e req-9f891d1b-fc61-4b6c-adf7-2b01a8e41b9d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:24 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-9a17c8ef-99d5-46c8-936c-679340b0c68e req-9f891d1b-fc61-4b6c-adf7-2b01a8e41b9d service nova] Creating event network-changed:64234034-3bc7-49ec-adb2-d425da7301e7 for instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f on user Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:24 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-9a17c8ef-99d5-46c8-936c-679340b0c68e req-9f891d1b-fc61-4b6c-adf7-2b01a8e41b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101457 Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:24 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 81/249] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:24 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-26171227-42bd-4cad-8e4d-36c0fa149527 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f/ips" status: 200 len: 103 microversion: 2.1 time: 0.046621 Apr 20 16:08:24 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:08:24 2023] GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f/ips => generated 103 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:24 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:08:24 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a HTTP/1.1 Apr 20 16:08:24 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:08:24 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:08:24 user devstack@n-api.service[61517]: Connection: close Apr 20 16:08:24 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:08:24 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:08:24 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:08:24 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:08:24 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:08:24 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:08:24 user devstack@n-api.service[61517]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:08:24 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:08:24 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:08:24 user devstack@n-api.service[61517]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:08:24 user devstack@n-api.service[61517]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:08:24 user devstack@n-api.service[61517]: method: > Apr 20 16:08:24 user devstack@n-api.service[61517]: exception: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:08:24 user devstack@n-api.service[61517]: action_args: {'id': 'c2b84ca2-f67b-4219-b7e6-18d2029e998a'} Apr 20 16:08:24 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:08:24 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:24 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:24 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-dd628753-44af-4591-bda9-fe8ac5298638 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a" status: 404 len: 111 microversion: 2.1 time: 0.150122 Apr 20 16:08:24 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 86/251] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:24 2023] GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:08:24 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-fa251e18-7358-4b56-a3f3-66cd99b59fa3 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '.version_select at 0x7f558798de10>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:24 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-fa251e18-7358-4b56-a3f3-66cd99b59fa3 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502137074" status: 202 len: 0 microversion: 2.1 time: 0.020927 Apr 20 16:08:24 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 82/252] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 16:08:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502137074 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:08:25 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-609f7b84-8131-4075-a5f2-74785b5959cc tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Action: 'create', calling method: .version_select at 0x7f5587976680>, body: {"keypair": {"name": "tempest-keypair-627338015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4OSrhcAGhvt/1td6lSrBTjgRGg10CjLCL1EmuHW6q7czt1RgqBpWAsoiQyoSTiBzeuddL47KN04jWageIBB5Wx1XgbbdYqtpRoz/r1eG4scj8/SDy6MikQDo96K7/ZPw=="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:25 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-609f7b84-8131-4075-a5f2-74785b5959cc tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for project 71cf2664111f45788d24092e8ceede9c. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:08:25 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-609f7b84-8131-4075-a5f2-74785b5959cc tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for user 690c49feae904687826fb959ba5ba283 and project 71cf2664111f45788d24092e8ceede9c. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:08:25 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-609f7b84-8131-4075-a5f2-74785b5959cc tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046851 Apr 20 16:08:25 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 85/253] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:08:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:25 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:08:26 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-dea51ff0-cfac-4c00-bbe2-0c44ceab5650 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f" status: 204 len: 0 microversion: 2.1 time: 0.120432 Apr 20 16:08:26 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 87/254] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:08:25 2023] DELETE /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:26 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8f57b12bc749888ea89bdbee258811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f831070f5847bda788f6f0fcfedb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:26 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-266cac45-e910-4843-9ee2-6aaea318e268 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f" status: 200 len: 1659 microversion: 2.1 time: 0.198363 Apr 20 16:08:26 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 83/255] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:26 2023] GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f => generated 1659 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:08:26 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-fdb10f1c-aadc-43b7-a938-91c647d2f6da req-66700460-a8bd-4df0-97ba-036eb63f06e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac0a246-e2fe-4164-9bc1-c96bb94e396f", "name": "network-vif-unplugged", "status": "completed", "tag": "64234034-3bc7-49ec-adb2-d425da7301e7"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:26 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-fdb10f1c-aadc-43b7-a938-91c647d2f6da req-66700460-a8bd-4df0-97ba-036eb63f06e8 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:26 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-fdb10f1c-aadc-43b7-a938-91c647d2f6da req-66700460-a8bd-4df0-97ba-036eb63f06e8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:26 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-fdb10f1c-aadc-43b7-a938-91c647d2f6da req-66700460-a8bd-4df0-97ba-036eb63f06e8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:26 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-fdb10f1c-aadc-43b7-a938-91c647d2f6da req-66700460-a8bd-4df0-97ba-036eb63f06e8 service nova] Creating event network-vif-unplugged:64234034-3bc7-49ec-adb2-d425da7301e7 for instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f on user Apr 20 16:08:26 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-fdb10f1c-aadc-43b7-a938-91c647d2f6da req-66700460-a8bd-4df0-97ba-036eb63f06e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085199 Apr 20 16:08:26 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:27 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] HTTP exception thrown: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Request method failure captured: Apr 20 16:08:27 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 HTTP/1.1 Apr 20 16:08:27 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:08:27 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:08:27 user devstack@n-api.service[61517]: Connection: close Apr 20 16:08:27 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:08:27 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:08:27 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:08:27 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:08:27 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWInXta5nx85YTf4JKYtG4PaASCPKsMF2yEgjqMuO3z2joKUKuU4k255Y8HcFoZKO2QvY3kyzt_1Hj-TcVl1WY6lMRWzZg5Hcs-srpz6pdOJnOUBL5t4McD0QCpjCcVAsdWBqYj6M-8jFdJ91JyK4SGGQLcExoh-S32sWe3NXPj0Hb4 Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Project-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Tenant-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:27 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:27 user devstack@n-api.service[61517]: X-User: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:27 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:08:27 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:08:27 user devstack@n-api.service[61517]: X-User-Id: f50dbce30f294bb0ba6bc2811025835d Apr 20 16:08:27 user devstack@n-api.service[61517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:27 user devstack@n-api.service[61517]: method: > Apr 20 16:08:27 user devstack@n-api.service[61517]: exception: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:27 user devstack@n-api.service[61517]: action_args: {'id': 'a760987f-1a65-4e42-8cef-73db9ef2db48'} Apr 20 16:08:27 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:27 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Returning 404 to user: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:27 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-1956fc68-e347-4367-96fa-1ec7fcdc105e tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48" status: 404 len: 111 microversion: 2.20 time: 0.158339 Apr 20 16:08:27 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 88/257] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:08:27 2023] GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-1f68f315-27a3-4087-b82f-395a2263fbdd tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '.version_select at 0x7f558798e9e0>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:27 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-1f68f315-27a3-4087-b82f-395a2263fbdd tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297016939" status: 204 len: 0 microversion: 2.20 time: 0.022123 Apr 20 16:08:27 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 84/258] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 20 16:08:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297016939 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:08:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-3951f69f-929a-4dc6-b663-f897e84600e4 req-fbf08cd3-2388-46cc-9498-d7d748b21d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac0a246-e2fe-4164-9bc1-c96bb94e396f", "name": "network-vif-deleted", "tag": "64234034-3bc7-49ec-adb2-d425da7301e7"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-3951f69f-929a-4dc6-b663-f897e84600e4 req-fbf08cd3-2388-46cc-9498-d7d748b21d1d service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-3951f69f-929a-4dc6-b663-f897e84600e4 req-fbf08cd3-2388-46cc-9498-d7d748b21d1d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:27 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-3951f69f-929a-4dc6-b663-f897e84600e4 req-fbf08cd3-2388-46cc-9498-d7d748b21d1d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:27 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-3951f69f-929a-4dc6-b663-f897e84600e4 req-fbf08cd3-2388-46cc-9498-d7d748b21d1d service nova] Creating event network-vif-deleted:64234034-3bc7-49ec-adb2-d425da7301e7 for instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f on user Apr 20 16:08:27 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-3951f69f-929a-4dc6-b663-f897e84600e4 req-fbf08cd3-2388-46cc-9498-d7d748b21d1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029327 Apr 20 16:08:27 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-407901735", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2dc9b3da-0124-4718-9f70-a131cd030480"}], "security_groups": [{"name": "tempest-securitygroup--1130356135"}], "key_name": "tempest-keypair-627338015", "user_data": "}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:27 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] validate_networks() for [('2dc9b3da-0124-4718-9f70-a131cd030480', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:08:27 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:27 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-550429c1-4037-46c8-89a8-335d2d56cc25 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 200 len: 1494 microversion: 2.1 time: 0.365615 Apr 20 16:08:27 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 85/260] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:27 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] HTTP exception thrown: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Request method failure captured: Apr 20 16:08:28 user devstack@n-api.service[61518]: request: DELETE /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 HTTP/1.1 Apr 20 16:08:28 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:08:28 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:08:28 user devstack@n-api.service[61518]: Connection: close Apr 20 16:08:28 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:08:28 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:08:28 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:08:28 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:08:28 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWInXta5nx85YTf4JKYtG4PaASCPKsMF2yEgjqMuO3z2joKUKuU4k255Y8HcFoZKO2QvY3kyzt_1Hj-TcVl1WY6lMRWzZg5Hcs-srpz6pdOJnOUBL5t4McD0QCpjCcVAsdWBqYj6M-8jFdJ91JyK4SGGQLcExoh-S32sWe3NXPj0Hb4 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Id: f50dbce30f294bb0ba6bc2811025835d Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61518]: method: > Apr 20 16:08:28 user devstack@n-api.service[61518]: exception: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: action_args: {'id': 'a760987f-1a65-4e42-8cef-73db9ef2db48'} Apr 20 16:08:28 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Returning 404 to user: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:28 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-f3f77b45-e8a0-4d39-a32f-1a82c20394cf tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48" status: 404 len: 111 microversion: 2.20 time: 0.027121 Apr 20 16:08:28 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 88/261] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:08:28 2023] DELETE /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: a760987f-1a65-4e42-8cef-73db9ef2db48] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] HTTP exception thrown: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Request method failure captured: Apr 20 16:08:28 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 HTTP/1.1 Apr 20 16:08:28 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:08:28 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:08:28 user devstack@n-api.service[61519]: Connection: close Apr 20 16:08:28 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:08:28 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:08:28 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:08:28 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:08:28 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWInXta5nx85YTf4JKYtG4PaASCPKsMF2yEgjqMuO3z2joKUKuU4k255Y8HcFoZKO2QvY3kyzt_1Hj-TcVl1WY6lMRWzZg5Hcs-srpz6pdOJnOUBL5t4McD0QCpjCcVAsdWBqYj6M-8jFdJ91JyK4SGGQLcExoh-S32sWe3NXPj0Hb4 Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Project-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Tenant-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61519]: X-User: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61519]: X-User-Id: f50dbce30f294bb0ba6bc2811025835d Apr 20 16:08:28 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61519]: method: > Apr 20 16:08:28 user devstack@n-api.service[61519]: exception: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61519]: action_args: {'id': 'a760987f-1a65-4e42-8cef-73db9ef2db48'} Apr 20 16:08:28 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Returning 404 to user: Instance a760987f-1a65-4e42-8cef-73db9ef2db48 could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:28 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-73971684-1d10-4c73-85fa-68493b51de26 tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48" status: 404 len: 111 microversion: 2.20 time: 0.026947 Apr 20 16:08:28 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 86/262] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:08:28 2023] GET /compute/v2.1/servers/a760987f-1a65-4e42-8cef-73db9ef2db48 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-a7ad98e0-4490-443d-94e2-38cc4b604954 req-a90e293d-30c8-422c-82f1-a04040ed292a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac0a246-e2fe-4164-9bc1-c96bb94e396f", "name": "network-vif-plugged", "status": "completed", "tag": "64234034-3bc7-49ec-adb2-d425da7301e7"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a7ad98e0-4490-443d-94e2-38cc4b604954 req-a90e293d-30c8-422c-82f1-a04040ed292a service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a7ad98e0-4490-443d-94e2-38cc4b604954 req-a90e293d-30c8-422c-82f1-a04040ed292a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-a7ad98e0-4490-443d-94e2-38cc4b604954 req-a90e293d-30c8-422c-82f1-a04040ed292a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for project 71cf2664111f45788d24092e8ceede9c. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:08:28 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] HTTP exception thrown: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Request method failure captured: Apr 20 16:08:28 user devstack@n-api.service[61518]: request: DELETE /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 HTTP/1.1 Apr 20 16:08:28 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:08:28 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:08:28 user devstack@n-api.service[61518]: Connection: close Apr 20 16:08:28 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:08:28 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:08:28 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:08:28 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:08:28 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWInXta5nx85YTf4JKYtG4PaASCPKsMF2yEgjqMuO3z2joKUKuU4k255Y8HcFoZKO2QvY3kyzt_1Hj-TcVl1WY6lMRWzZg5Hcs-srpz6pdOJnOUBL5t4McD0QCpjCcVAsdWBqYj6M-8jFdJ91JyK4SGGQLcExoh-S32sWe3NXPj0Hb4 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Id: f50dbce30f294bb0ba6bc2811025835d Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61518]: method: > Apr 20 16:08:28 user devstack@n-api.service[61518]: exception: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: action_args: {'id': '5bda996a-1bfe-4f43-aa02-36a864153588'} Apr 20 16:08:28 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Returning 404 to user: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:28 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-213c66e0-3dc5-4d25-8a07-74bca9b1d2cc tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588" status: 404 len: 111 microversion: 2.20 time: 0.036539 Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Getting quotas for user 690c49feae904687826fb959ba5ba283 and project 71cf2664111f45788d24092e8ceede9c. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:08:28 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 89/263] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:08:28 2023] DELETE /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:08:28 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-a7ad98e0-4490-443d-94e2-38cc4b604954 req-a90e293d-30c8-422c-82f1-a04040ed292a service nova] Creating event network-vif-plugged:64234034-3bc7-49ec-adb2-d425da7301e7 for instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f on user Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] [instance: 5bda996a-1bfe-4f43-aa02-36a864153588] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:28 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-a7ad98e0-4490-443d-94e2-38cc4b604954 req-a90e293d-30c8-422c-82f1-a04040ed292a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027478 Apr 20 16:08:28 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 87/264] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:08:28 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:08:28 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] HTTP exception thrown: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Request method failure captured: Apr 20 16:08:28 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 HTTP/1.1 Apr 20 16:08:28 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:08:28 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:08:28 user devstack@n-api.service[61518]: Connection: close Apr 20 16:08:28 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:08:28 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:08:28 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:08:28 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:08:28 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWInXta5nx85YTf4JKYtG4PaASCPKsMF2yEgjqMuO3z2joKUKuU4k255Y8HcFoZKO2QvY3kyzt_1Hj-TcVl1WY6lMRWzZg5Hcs-srpz6pdOJnOUBL5t4McD0QCpjCcVAsdWBqYj6M-8jFdJ91JyK4SGGQLcExoh-S32sWe3NXPj0Hb4 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0a5eb3796a4d3a871843f409c6ffbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant-Id: cb0a5eb3796a4d3a871843f409c6ffbd Apr 20 16:08:28 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1118127371 Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Id: f50dbce30f294bb0ba6bc2811025835d Apr 20 16:08:28 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1118127371-project-member Apr 20 16:08:28 user devstack@n-api.service[61518]: method: > Apr 20 16:08:28 user devstack@n-api.service[61518]: exception: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: action_args: {'id': '5bda996a-1bfe-4f43-aa02-36a864153588'} Apr 20 16:08:28 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. Apr 20 16:08:28 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:28 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] Returning 404 to user: Instance 5bda996a-1bfe-4f43-aa02-36a864153588 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:28 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-13aa5645-8949-4f59-a04a-e3ddfc509eff tempest-AttachVolumeShelveTestJSON-1118127371 tempest-AttachVolumeShelveTestJSON-1118127371-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588" status: 404 len: 111 microversion: 2.20 time: 0.028787 Apr 20 16:08:28 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 90/265] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:08:28 2023] GET /compute/v2.1/servers/5bda996a-1bfe-4f43-aa02-36a864153588 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 20 16:08:28 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-bd6fa3be-8657-4417-844e-c9c5eaec9e19 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.926258 Apr 20 16:08:28 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 89/266] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:08:27 2023] POST /compute/v2.1/servers => generated 400 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-b172782a-3b08-467a-97db-4f4799de1cb2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-b172782a-3b08-467a-97db-4f4799de1cb2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:28 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-b172782a-3b08-467a-97db-4f4799de1cb2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:28 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-b172782a-3b08-467a-97db-4f4799de1cb2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f" status: 200 len: 1234 microversion: 2.1 time: 0.080340 Apr 20 16:08:28 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 88/267] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:28 2023] GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f => generated 1234 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:08:31 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-a7b62f94-8b62-4b33-8469-53d0bfd88218 req-1838486e-464b-4510-89c9-a55de6e8b680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d19a54-ca7e-46fc-af21-6a7ddbc6604f", "tag": "9223f738-4299-44ed-8e8f-c39e3353e39d"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-a7b62f94-8b62-4b33-8469-53d0bfd88218 req-1838486e-464b-4510-89c9-a55de6e8b680 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-a7b62f94-8b62-4b33-8469-53d0bfd88218 req-1838486e-464b-4510-89c9-a55de6e8b680 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-a7b62f94-8b62-4b33-8469-53d0bfd88218 req-1838486e-464b-4510-89c9-a55de6e8b680 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:31 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-a7b62f94-8b62-4b33-8469-53d0bfd88218 req-1838486e-464b-4510-89c9-a55de6e8b680 service nova] Creating event network-changed:9223f738-4299-44ed-8e8f-c39e3353e39d for instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f on user Apr 20 16:08:31 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-a7b62f94-8b62-4b33-8469-53d0bfd88218 req-1838486e-464b-4510-89c9-a55de6e8b680 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031337 Apr 20 16:08:31 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 91/268] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: a145fb51-4ca5-4cc4-b8bd-cd3665bef473] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] HTTP exception thrown: Instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 could not be found. Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Request method failure captured: Apr 20 16:08:32 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473 HTTP/1.1 Apr 20 16:08:32 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:08:32 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:08:32 user devstack@n-api.service[61517]: Connection: close Apr 20 16:08:32 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:08:32 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:08:32 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:08:32 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:08:32 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWJbl2VOQQoy_3bIWrKVQqbJOePNHfa-iDss8-FSv-dH_p43hMpaWTvwO6OJk40c9-OJH1fUz526ZzgBQ4IaxB0UOMbgNM1kB6owvJFa8oYHSKOO-GIbd0LGXZO4tZQBf0QyXM6OrBtt1Ns4T8tI4mcHLj2xSTWoxXcFf_m9h8th3pY Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Project-Id: a92cea9e1182477ca669c506b42eda60 Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Project-Name: tempest-VolumesAdminNegativeTest-978356230 Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92cea9e1182477ca669c506b42eda60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92cea9e1182477ca669c506b42eda60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92cea9e1182477ca669c506b42eda60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Tenant: tempest-VolumesAdminNegativeTest-978356230 Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Tenant-Id: a92cea9e1182477ca669c506b42eda60 Apr 20 16:08:32 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-978356230 Apr 20 16:08:32 user devstack@n-api.service[61517]: X-User: tempest-VolumesAdminNegativeTest-978356230-project-member Apr 20 16:08:32 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:08:32 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:08:32 user devstack@n-api.service[61517]: X-User-Id: c92692a1d38b4531a4e7f42660a54c7b Apr 20 16:08:32 user devstack@n-api.service[61517]: X-User-Name: tempest-VolumesAdminNegativeTest-978356230-project-member Apr 20 16:08:32 user devstack@n-api.service[61517]: method: > Apr 20 16:08:32 user devstack@n-api.service[61517]: exception: Instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 could not be found. Apr 20 16:08:32 user devstack@n-api.service[61517]: action_args: {'id': 'a145fb51-4ca5-4cc4-b8bd-cd3665bef473'} Apr 20 16:08:32 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 could not be found. Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 could not be found. Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 could not be found. Apr 20 16:08:32 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Returning 404 to user: Instance a145fb51-4ca5-4cc4-b8bd-cd3665bef473 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:32 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-66259a62-a99c-4c24-ba34-cb82035dfafa tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473" status: 404 len: 111 microversion: 2.1 time: 0.027789 Apr 20 16:08:32 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:32 2023] GET /compute/v2.1/servers/a145fb51-4ca5-4cc4-b8bd-cd3665bef473 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-56741221-d9d7-4f0e-8629-9a6021dc62c2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7" status: 204 len: 0 microversion: 2.1 time: 0.124717 Apr 20 16:08:32 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 89/270] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:08:32 2023] DELETE /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:08:32 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-ccc4485d-07c2-4101-b5af-b6e3e0fec6d4 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854" status: 204 len: 0 microversion: 2.1 time: 0.164189 Apr 20 16:08:32 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 92/271] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:08:32 2023] DELETE /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-14de8892-f80e-485e-a1c2-73df3d569b1b tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Action: 'create', calling method: .version_select at 0x7f5587976680>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1316967719", "metadata": {"Type": "work"}}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-14de8892-f80e-485e-a1c2-73df3d569b1b tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Request method failure captured: Apr 20 16:08:33 user devstack@n-api.service[61518]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 16:08:33 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:08:33 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:08:33 user devstack@n-api.service[61518]: Connection: close Apr 20 16:08:33 user devstack@n-api.service[61518]: Content-Length: 122 Apr 20 16:08:33 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:08:33 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:08:33 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:08:33 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWOBgJXMeku5_Y0zBhsxuwc4PQq8Sxk3jFTTk9gU6pS6wWALBt0itks_YXi0j-yqCxOfsAcebybUTwz30xzeTzJTfW94I5g0wmsGZfQKjO7sQMlds_46cG0tok1OrHLE31ncW75X4w6akzWweHhSl66VxRv7lyX9Ysdg_Kq36EEMGUU Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Project-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Project-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b1353732df64d3984928690036add4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Tenant: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Tenant-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61518]: X-User: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61518]: X-User-Id: f28fcb86d7bc459abeeda5c0aab1ec88 Apr 20 16:08:33 user devstack@n-api.service[61518]: X-User-Name: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61518]: Apr 20 16:08:33 user devstack@n-api.service[61518]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1316967719", "metadata": {"Type": "work"}}} Apr 20 16:08:33 user devstack@n-api.service[61518]: method: Apr 20 16:08:33 user devstack@n-api.service[61518]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61518]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1316967719', 'metadata': {'Type': 'work'}}}} Apr 20 16:08:33 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise error Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi '#$%' Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-14de8892-f80e-485e-a1c2-73df3d569b1b tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:33 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-14de8892-f80e-485e-a1c2-73df3d569b1b tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.214742 Apr 20 16:08:33 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 93/272] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 16:08:33 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-654b8c64-f4ce-46f9-a11e-1fc2ed769ba2 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7" status: 200 len: 1497 microversion: 2.1 time: 0.878847 Apr 20 16:08:33 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 91/273] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:32 2023] GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 => generated 1497 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-430cd2e1-4068-4d2e-9f7f-fb0a99338f33 req-0061ca9f-bcc7-4235-b0f1-0b108940c5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc918ed4-8bc6-4a4f-a189-d6cdd5817854", "name": "network-vif-unplugged", "status": "completed", "tag": "74703b46-6b03-4752-953b-9c64a63249c8"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92692a1d38b4531a4e7f42660a54c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92cea9e1182477ca669c506b42eda60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-430cd2e1-4068-4d2e-9f7f-fb0a99338f33 req-0061ca9f-bcc7-4235-b0f1-0b108940c5b1 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-430cd2e1-4068-4d2e-9f7f-fb0a99338f33 req-0061ca9f-bcc7-4235-b0f1-0b108940c5b1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-430cd2e1-4068-4d2e-9f7f-fb0a99338f33 req-0061ca9f-bcc7-4235-b0f1-0b108940c5b1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-38a7a5d3-0d41-4d57-9086-cf2d0cfe9014 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854" status: 200 len: 1664 microversion: 2.1 time: 0.764911 Apr 20 16:08:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 90/274] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:32 2023] GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854 => generated 1664 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-430cd2e1-4068-4d2e-9f7f-fb0a99338f33 req-0061ca9f-bcc7-4235-b0f1-0b108940c5b1 service nova] Creating event network-vif-unplugged:74703b46-6b03-4752-953b-9c64a63249c8 for instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 on user Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-430cd2e1-4068-4d2e-9f7f-fb0a99338f33 req-0061ca9f-bcc7-4235-b0f1-0b108940c5b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035282 Apr 20 16:08:33 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 92/275] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-ab4b4efe-3a8a-4011-9cc3-9dd272f0bf79 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Action: 'create', calling method: .version_select at 0x7f558784ba30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1182945987", "metadata": {"Type": "work"}}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-b36edb28-c674-438d-87ea-84ba5e0c57b9 req-51b7fdb2-b023-4f45-ad6a-702251a1dfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-unplugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-ab4b4efe-3a8a-4011-9cc3-9dd272f0bf79 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Request method failure captured: Apr 20 16:08:33 user devstack@n-api.service[61519]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:08:33 user devstack@n-api.service[61519]: Connection: close Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Length: 120 Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:08:33 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:08:33 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWOBgJXMeku5_Y0zBhsxuwc4PQq8Sxk3jFTTk9gU6pS6wWALBt0itks_YXi0j-yqCxOfsAcebybUTwz30xzeTzJTfW94I5g0wmsGZfQKjO7sQMlds_46cG0tok1OrHLE31ncW75X4w6akzWweHhSl66VxRv7lyX9Ysdg_Kq36EEMGUU Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b1353732df64d3984928690036add4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Id: f28fcb86d7bc459abeeda5c0aab1ec88 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Name: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: Apr 20 16:08:33 user devstack@n-api.service[61519]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1182945987", "metadata": {"Type": "work"}}} Apr 20 16:08:33 user devstack@n-api.service[61519]: method: Apr 20 16:08:33 user devstack@n-api.service[61519]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 16:08:33 user devstack@n-api.service[61519]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1182945987', 'metadata': {'Type': 'work'}}}} Apr 20 16:08:33 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise error Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi '0' Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-ab4b4efe-3a8a-4011-9cc3-9dd272f0bf79 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-ab4b4efe-3a8a-4011-9cc3-9dd272f0bf79 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012663 Apr 20 16:08:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 91/276] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 16:08:33 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-b36edb28-c674-438d-87ea-84ba5e0c57b9 req-51b7fdb2-b023-4f45-ad6a-702251a1dfc8 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-b36edb28-c674-438d-87ea-84ba5e0c57b9 req-51b7fdb2-b023-4f45-ad6a-702251a1dfc8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-b36edb28-c674-438d-87ea-84ba5e0c57b9 req-51b7fdb2-b023-4f45-ad6a-702251a1dfc8 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-8b393199-f727-457b-bfe6-a1d8755563d8 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Action: 'create', calling method: .version_select at 0x7f558785dfc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-721803412", "metadata": {"Type": "work"}}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-8b393199-f727-457b-bfe6-a1d8755563d8 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Request method failure captured: Apr 20 16:08:33 user devstack@n-api.service[61519]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:08:33 user devstack@n-api.service[61519]: Connection: close Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Length: 118 Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:08:33 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:08:33 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWOBgJXMeku5_Y0zBhsxuwc4PQq8Sxk3jFTTk9gU6pS6wWALBt0itks_YXi0j-yqCxOfsAcebybUTwz30xzeTzJTfW94I5g0wmsGZfQKjO7sQMlds_46cG0tok1OrHLE31ncW75X4w6akzWweHhSl66VxRv7lyX9Ysdg_Kq36EEMGUU Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b1353732df64d3984928690036add4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Id: f28fcb86d7bc459abeeda5c0aab1ec88 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Name: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: Apr 20 16:08:33 user devstack@n-api.service[61519]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-721803412", "metadata": {"Type": "work"}}} Apr 20 16:08:33 user devstack@n-api.service[61519]: method: Apr 20 16:08:33 user devstack@n-api.service[61519]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61519]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-721803412', 'metadata': {'Type': 'work'}}}} Apr 20 16:08:33 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise error Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi '' Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-8b393199-f727-457b-bfe6-a1d8755563d8 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-8b393199-f727-457b-bfe6-a1d8755563d8 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015655 Apr 20 16:08:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 92/277] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 16:08:33 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-b36edb28-c674-438d-87ea-84ba5e0c57b9 req-51b7fdb2-b023-4f45-ad6a-702251a1dfc8 service nova] Creating event network-vif-unplugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-b36edb28-c674-438d-87ea-84ba5e0c57b9 req-51b7fdb2-b023-4f45-ad6a-702251a1dfc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041368 Apr 20 16:08:33 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 93/278] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-839076cc-8949-4cc1-8c7f-6acde5574a8c tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Calling method '.version_select at 0x7f5587b7f250>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-839076cc-8949-4cc1-8c7f-6acde5574a8c tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] HTTP exception thrown: Volume tempest-invalid-1378186967 could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-839076cc-8949-4cc1-8c7f-6acde5574a8c tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Request method failure captured: Apr 20 16:08:33 user devstack@n-api.service[61519]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1378186967 HTTP/1.1 Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:08:33 user devstack@n-api.service[61519]: Connection: close Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:08:33 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:08:33 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWOBgJXMeku5_Y0zBhsxuwc4PQq8Sxk3jFTTk9gU6pS6wWALBt0itks_YXi0j-yqCxOfsAcebybUTwz30xzeTzJTfW94I5g0wmsGZfQKjO7sQMlds_46cG0tok1OrHLE31ncW75X4w6akzWweHhSl66VxRv7lyX9Ysdg_Kq36EEMGUU Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b1353732df64d3984928690036add4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Id: f28fcb86d7bc459abeeda5c0aab1ec88 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Name: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: method: Apr 20 16:08:33 user devstack@n-api.service[61519]: exception: Volume tempest-invalid-1378186967 could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: action_args: {'id': 'tempest-invalid-1378186967'} Apr 20 16:08:33 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1378186967 could not be found. (HTTP 404) (Request-ID: req-04148d67-4662-4392-9064-ca65596e2b39) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1378186967 could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1378186967 could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1378186967 could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-839076cc-8949-4cc1-8c7f-6acde5574a8c tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Returning 404 to user: Volume tempest-invalid-1378186967 could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-839076cc-8949-4cc1-8c7f-6acde5574a8c tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1378186967" status: 404 len: 99 microversion: 2.1 time: 0.036836 Apr 20 16:08:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 93/279] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 16:08:33 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1378186967 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-99722092-91f5-4b0c-8718-9bef21f1abc3 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003705 Apr 20 16:08:33 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 94/280] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 20 16:08:33 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-a54135f2-590a-44d8-8faa-bb58d338f059 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004437 Apr 20 16:08:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 20 16:08:33 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-a5104f94-3ed3-4b75-bcdf-9e1285cf0933 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Calling method '.version_select at 0x7f55879f3760>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-a5104f94-3ed3-4b75-bcdf-9e1285cf0933 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] HTTP exception thrown: Volume 79b4e358-693c-40e2-abcf-9dabd1a6c37e could not be found. Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-a5104f94-3ed3-4b75-bcdf-9e1285cf0933 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Request method failure captured: Apr 20 16:08:33 user devstack@n-api.service[61517]: request: DELETE /compute/v2.1/os-volumes/79b4e358-693c-40e2-abcf-9dabd1a6c37e HTTP/1.1 Apr 20 16:08:33 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:08:33 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:08:33 user devstack@n-api.service[61517]: Connection: close Apr 20 16:08:33 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:08:33 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:08:33 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:08:33 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:08:33 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWOBgJXMeku5_Y0zBhsxuwc4PQq8Sxk3jFTTk9gU6pS6wWALBt0itks_YXi0j-yqCxOfsAcebybUTwz30xzeTzJTfW94I5g0wmsGZfQKjO7sQMlds_46cG0tok1OrHLE31ncW75X4w6akzWweHhSl66VxRv7lyX9Ysdg_Kq36EEMGUU Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Project-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Project-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b1353732df64d3984928690036add4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Tenant: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Tenant-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61517]: X-User: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61517]: X-User-Id: f28fcb86d7bc459abeeda5c0aab1ec88 Apr 20 16:08:33 user devstack@n-api.service[61517]: X-User-Name: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61517]: method: Apr 20 16:08:33 user devstack@n-api.service[61517]: exception: Volume 79b4e358-693c-40e2-abcf-9dabd1a6c37e could not be found. Apr 20 16:08:33 user devstack@n-api.service[61517]: action_args: {'id': '79b4e358-693c-40e2-abcf-9dabd1a6c37e'} Apr 20 16:08:33 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79b4e358-693c-40e2-abcf-9dabd1a6c37e could not be found. (HTTP 404) (Request-ID: req-9ea4a496-594a-40af-8b78-e48330ddb19c) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79b4e358-693c-40e2-abcf-9dabd1a6c37e could not be found. Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79b4e358-693c-40e2-abcf-9dabd1a6c37e could not be found. Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79b4e358-693c-40e2-abcf-9dabd1a6c37e could not be found. Apr 20 16:08:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-a5104f94-3ed3-4b75-bcdf-9e1285cf0933 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Returning 404 to user: Volume 79b4e358-693c-40e2-abcf-9dabd1a6c37e could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-a5104f94-3ed3-4b75-bcdf-9e1285cf0933 tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/79b4e358-693c-40e2-abcf-9dabd1a6c37e" status: 404 len: 109 microversion: 2.1 time: 0.039495 Apr 20 16:08:33 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:08:33 2023] DELETE /compute/v2.1/os-volumes/79b4e358-693c-40e2-abcf-9dabd1a6c37e => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-84f4dd94-3a48-4c26-bda2-68e5ea51c3cf tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Calling method '.version_select at 0x7f5587b7f2e0>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-84f4dd94-3a48-4c26-bda2-68e5ea51c3cf tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] HTTP exception thrown: Volume e25f66b5-8784-4333-a69b-5a745f34940d could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-84f4dd94-3a48-4c26-bda2-68e5ea51c3cf tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Request method failure captured: Apr 20 16:08:33 user devstack@n-api.service[61519]: request: GET /compute/v2.1/os-volumes/e25f66b5-8784-4333-a69b-5a745f34940d HTTP/1.1 Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:08:33 user devstack@n-api.service[61519]: Connection: close Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:08:33 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:08:33 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:08:33 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:08:33 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWOBgJXMeku5_Y0zBhsxuwc4PQq8Sxk3jFTTk9gU6pS6wWALBt0itks_YXi0j-yqCxOfsAcebybUTwz30xzeTzJTfW94I5g0wmsGZfQKjO7sQMlds_46cG0tok1OrHLE31ncW75X4w6akzWweHhSl66VxRv7lyX9Ysdg_Kq36EEMGUU Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Project-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b1353732df64d3984928690036add4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b1353732df64d3984928690036add4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Id: 0b1353732df64d3984928690036add4e Apr 20 16:08:33 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-VolumesNegativeTest-404255941 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Id: f28fcb86d7bc459abeeda5c0aab1ec88 Apr 20 16:08:33 user devstack@n-api.service[61519]: X-User-Name: tempest-VolumesNegativeTest-404255941-project-member Apr 20 16:08:33 user devstack@n-api.service[61519]: method: Apr 20 16:08:33 user devstack@n-api.service[61519]: exception: Volume e25f66b5-8784-4333-a69b-5a745f34940d could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: action_args: {'id': 'e25f66b5-8784-4333-a69b-5a745f34940d'} Apr 20 16:08:33 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e25f66b5-8784-4333-a69b-5a745f34940d could not be found. (HTTP 404) (Request-ID: req-c0e3efae-b643-4468-b676-6423b6b22a91) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e25f66b5-8784-4333-a69b-5a745f34940d could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e25f66b5-8784-4333-a69b-5a745f34940d could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e25f66b5-8784-4333-a69b-5a745f34940d could not be found. Apr 20 16:08:33 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:08:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-84f4dd94-3a48-4c26-bda2-68e5ea51c3cf tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] Returning 404 to user: Volume e25f66b5-8784-4333-a69b-5a745f34940d could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:08:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-84f4dd94-3a48-4c26-bda2-68e5ea51c3cf tempest-VolumesNegativeTest-404255941 tempest-VolumesNegativeTest-404255941-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e25f66b5-8784-4333-a69b-5a745f34940d" status: 404 len: 109 microversion: 2.1 time: 0.050670 Apr 20 16:08:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 95/283] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 16:08:33 2023] GET /compute/v2.1/os-volumes/e25f66b5-8784-4333-a69b-5a745f34940d => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:08:34 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:34 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-3b790688-5bb1-4b3d-9048-c555b80f46f1 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.999073 Apr 20 16:08:34 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 94/284] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:33 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:34 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:34 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-3617416d-2694-4300-a09b-beb8833f2baa tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.544863 Apr 20 16:08:34 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:34 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:08:35 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-plugged", "status": "completed", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "fe0bde76-a4f8-4865-91af-2bd3790587a7", "name": "network-vif-deleted", "tag": "9f4d2191-16c0-4ab6-a4bd-f016499a9aad"}, {"server_uuid": "dc918ed4-8bc6-4a4f-a189-d6cdd5817854", "name": "network-vif-deleted", "tag": "74703b46-6b03-4752-953b-9c64a63249c8"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] Creating event network-vif-plugged:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:08:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] Creating event network-vif-deleted:9f4d2191-16c0-4ab6-a4bd-f016499a9aad for instance fe0bde76-a4f8-4865-91af-2bd3790587a7 on user Apr 20 16:08:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] Creating event network-vif-deleted:74703b46-6b03-4752-953b-9c64a63249c8 for instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 on user Apr 20 16:08:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-ad5c6a56-5a31-4660-b3c2-afdc1ad72cdd req-db778cad-3705-41d2-b3d4-478e4b149220 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046970 Apr 20 16:08:35 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 96/286] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:35 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:36 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc918ed4-8bc6-4a4f-a189-d6cdd5817854", "name": "network-vif-plugged", "status": "completed", "tag": "74703b46-6b03-4752-953b-9c64a63249c8"}, {"server_uuid": "f6d19a54-ca7e-46fc-af21-6a7ddbc6604f", "name": "network-vif-plugged", "status": "completed", "tag": "9223f738-4299-44ed-8e8f-c39e3353e39d"}, {"server_uuid": "f6d19a54-ca7e-46fc-af21-6a7ddbc6604f", "name": "network-vif-plugged", "status": "completed", "tag": "9223f738-4299-44ed-8e8f-c39e3353e39d"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:08:36 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:36 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] Creating event network-vif-plugged:74703b46-6b03-4752-953b-9c64a63249c8 for instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 on user Apr 20 16:08:36 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] Creating event network-vif-plugged:9223f738-4299-44ed-8e8f-c39e3353e39d for instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f on user Apr 20 16:08:36 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] Creating event network-vif-plugged:9223f738-4299-44ed-8e8f-c39e3353e39d for instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f on user Apr 20 16:08:36 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-b31e41e5-13ab-45c2-8c8f-0dece4e8c099 req-5727c52e-0c35-4f02-ac7c-191863f39333 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047694 Apr 20 16:08:36 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 95/287] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:08:36 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] [instance: 4f841186-7958-4642-9050-9b048b61ebbb] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:08:43 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403bee038ece4e9aa023aad83ee8f188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92faae7a5d40f98409e9634a9dbf9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:08:43 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-36e007b6-b616-4f2b-9e71-79ccccb02367 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb" status: 200 len: 1485 microversion: 2.1 time: 0.222639 Apr 20 16:08:43 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 97/288] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:08:43 2023] GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb => generated 1485 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:16 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] HTTP exception thrown: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Request method failure captured: Apr 20 16:09:16 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f HTTP/1.1 Apr 20 16:09:16 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:09:16 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:09:16 user devstack@n-api.service[61519]: Connection: close Apr 20 16:09:16 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:09:16 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:09:16 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:09:16 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:09:16 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWJc1a0Gx-g20_AaUh2nbxzQ2AradtMfrLXtmX5w-wxUNFe97uqHcInR5ZKifxXevUVh5gr-MbZSJkEfmXl4nQy40QvTTxHuujqDw5s2eTIssS5jeRy52R2OzB574FRTjIolL9RGhjqOXFdohiV90HAz1GsrbBOQO9M0uoZAfan2SpM Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Project-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Tenant-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:16 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:16 user devstack@n-api.service[61519]: X-User: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:16 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:09:16 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:09:16 user devstack@n-api.service[61519]: X-User-Id: 1c8f57b12bc749888ea89bdbee258811 Apr 20 16:09:16 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:16 user devstack@n-api.service[61519]: method: > Apr 20 16:09:16 user devstack@n-api.service[61519]: exception: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:16 user devstack@n-api.service[61519]: action_args: {'id': '3ac0a246-e2fe-4164-9bc1-c96bb94e396f'} Apr 20 16:09:16 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:16 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:16 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Returning 404 to user: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:09:16 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-81a8ba0e-4397-462d-9f62-dbcdc9b8755a tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f" status: 404 len: 111 microversion: 2.1 time: 0.327879 Apr 20 16:09:16 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 97/289] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:16 2023] GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f => generated 111 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:09:16 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:16 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:16 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-b74cb552-6b43-4176-8c96-f828eefee2b2 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '.version_select at 0x7f55879d6dd0>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:16 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-b74cb552-6b43-4176-8c96-f828eefee2b2 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398342575" status: 202 len: 0 microversion: 2.1 time: 0.030895 Apr 20 16:09:16 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 96/290] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 16:09:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398342575 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] HTTP exception thrown: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Request method failure captured: Apr 20 16:09:17 user devstack@n-api.service[61517]: request: DELETE /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f HTTP/1.1 Apr 20 16:09:17 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:09:17 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:09:17 user devstack@n-api.service[61517]: Connection: close Apr 20 16:09:17 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:09:17 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:09:17 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:09:17 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:09:17 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWJc1a0Gx-g20_AaUh2nbxzQ2AradtMfrLXtmX5w-wxUNFe97uqHcInR5ZKifxXevUVh5gr-MbZSJkEfmXl4nQy40QvTTxHuujqDw5s2eTIssS5jeRy52R2OzB574FRTjIolL9RGhjqOXFdohiV90HAz1GsrbBOQO9M0uoZAfan2SpM Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Tenant: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Tenant-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Id: 1c8f57b12bc749888ea89bdbee258811 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Name: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61517]: method: > Apr 20 16:09:17 user devstack@n-api.service[61517]: exception: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: action_args: {'id': '3ac0a246-e2fe-4164-9bc1-c96bb94e396f'} Apr 20 16:09:17 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Returning 404 to user: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:09:17 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ce4eedab-3f66-4ae5-9770-223ea7fa7073 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f" status: 404 len: 111 microversion: 2.1 time: 0.055052 Apr 20 16:09:17 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 98/291] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:09:17 2023] DELETE /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: 3ac0a246-e2fe-4164-9bc1-c96bb94e396f] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] HTTP exception thrown: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Request method failure captured: Apr 20 16:09:17 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f HTTP/1.1 Apr 20 16:09:17 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:09:17 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:09:17 user devstack@n-api.service[61519]: Connection: close Apr 20 16:09:17 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:09:17 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:09:17 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:09:17 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:09:17 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWJc1a0Gx-g20_AaUh2nbxzQ2AradtMfrLXtmX5w-wxUNFe97uqHcInR5ZKifxXevUVh5gr-MbZSJkEfmXl4nQy40QvTTxHuujqDw5s2eTIssS5jeRy52R2OzB574FRTjIolL9RGhjqOXFdohiV90HAz1GsrbBOQO9M0uoZAfan2SpM Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Project-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Tenant-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61519]: X-User: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61519]: X-User-Id: 1c8f57b12bc749888ea89bdbee258811 Apr 20 16:09:17 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61519]: method: > Apr 20 16:09:17 user devstack@n-api.service[61519]: exception: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61519]: action_args: {'id': '3ac0a246-e2fe-4164-9bc1-c96bb94e396f'} Apr 20 16:09:17 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. Apr 20 16:09:17 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Returning 404 to user: Instance 3ac0a246-e2fe-4164-9bc1-c96bb94e396f could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:09:17 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-6bd9027a-39c1-478c-87cb-1aba1233a973 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f" status: 404 len: 111 microversion: 2.1 time: 0.033712 Apr 20 16:09:17 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:17 2023] GET /compute/v2.1/servers/3ac0a246-e2fe-4164-9bc1-c96bb94e396f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] HTTP exception thrown: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Request method failure captured: Apr 20 16:09:17 user devstack@n-api.service[61518]: request: DELETE /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 HTTP/1.1 Apr 20 16:09:17 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:09:17 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:09:17 user devstack@n-api.service[61518]: Connection: close Apr 20 16:09:17 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:09:17 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:09:17 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:09:17 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:09:17 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWJc1a0Gx-g20_AaUh2nbxzQ2AradtMfrLXtmX5w-wxUNFe97uqHcInR5ZKifxXevUVh5gr-MbZSJkEfmXl4nQy40QvTTxHuujqDw5s2eTIssS5jeRy52R2OzB574FRTjIolL9RGhjqOXFdohiV90HAz1GsrbBOQO9M0uoZAfan2SpM Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Project-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Tenant-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61518]: X-User: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61518]: X-User-Id: 1c8f57b12bc749888ea89bdbee258811 Apr 20 16:09:17 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61518]: method: > Apr 20 16:09:17 user devstack@n-api.service[61518]: exception: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61518]: action_args: {'id': 'e1036e0f-683f-4dfd-b0ad-6187d90ff2f6'} Apr 20 16:09:17 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Returning 404 to user: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:09:17 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-1523ebdc-4a6f-4ad0-a437-87be43e0bc01 tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6" status: 404 len: 111 microversion: 2.1 time: 0.028165 Apr 20 16:09:17 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:09:17 2023] DELETE /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] [instance: e1036e0f-683f-4dfd-b0ad-6187d90ff2f6] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:17 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] HTTP exception thrown: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Request method failure captured: Apr 20 16:09:17 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 HTTP/1.1 Apr 20 16:09:17 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:09:17 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:09:17 user devstack@n-api.service[61517]: Connection: close Apr 20 16:09:17 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:09:17 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:09:17 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:09:17 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:09:17 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWJc1a0Gx-g20_AaUh2nbxzQ2AradtMfrLXtmX5w-wxUNFe97uqHcInR5ZKifxXevUVh5gr-MbZSJkEfmXl4nQy40QvTTxHuujqDw5s2eTIssS5jeRy52R2OzB574FRTjIolL9RGhjqOXFdohiV90HAz1GsrbBOQO9M0uoZAfan2SpM Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Project-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77f831070f5847bda788f6f0fcfedb03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Tenant: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Tenant-Id: 77f831070f5847bda788f6f0fcfedb03 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1838780462 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Id: 1c8f57b12bc749888ea89bdbee258811 Apr 20 16:09:17 user devstack@n-api.service[61517]: X-User-Name: tempest-AttachVolumeTestJSON-1838780462-project-member Apr 20 16:09:17 user devstack@n-api.service[61517]: method: > Apr 20 16:09:17 user devstack@n-api.service[61517]: exception: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: action_args: {'id': 'e1036e0f-683f-4dfd-b0ad-6187d90ff2f6'} Apr 20 16:09:17 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. Apr 20 16:09:17 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:17 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] Returning 404 to user: Instance e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:09:17 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-fe52112c-102e-4176-b4c2-f3c56ee3157f tempest-AttachVolumeTestJSON-1838780462 tempest-AttachVolumeTestJSON-1838780462-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6" status: 404 len: 111 microversion: 2.1 time: 0.038414 Apr 20 16:09:17 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:17 2023] GET /compute/v2.1/servers/e1036e0f-683f-4dfd-b0ad-6187d90ff2f6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:18 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:09:18 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-288d4990-b3de-408d-a202-025a02bcf7c9 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f" status: 200 len: 1544 microversion: 2.1 time: 0.223357 Apr 20 16:09:18 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:18 2023] GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f => generated 1544 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: fe0bde76-a4f8-4865-91af-2bd3790587a7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] [instance: dc918ed4-8bc6-4a4f-a189-d6cdd5817854] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:23 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] HTTP exception thrown: Instance fe0bde76-a4f8-4865-91af-2bd3790587a7 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Request method failure captured: Apr 20 16:09:23 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 HTTP/1.1 Apr 20 16:09:23 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:09:23 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:09:23 user devstack@n-api.service[61518]: Connection: close Apr 20 16:09:23 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:09:23 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:09:23 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:09:23 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:09:23 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWJhcALwfSrIg_1H8aiI4fsrLQ3AduFxNI2UTQtXuNk8K1hPB3sthtC9ejeFX0qkUCZ__vRWqcWjQYmdp7Na8gFzKBKSeWJLyUa5hfFJ4yxCTTGXHunsRIJRhODg2xEeJmFNjuf3M5kUPWm-newujEjOlolyyJ79PUGPANfThb1XHEg Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Project-Id: 1d4a73ba128147f295bf6a4545fede47 Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-237285916 Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d4a73ba128147f295bf6a4545fede47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d4a73ba128147f295bf6a4545fede47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d4a73ba128147f295bf6a4545fede47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Tenant: tempest-ServerRescueNegativeTestJSON-237285916 Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Tenant-Id: 1d4a73ba128147f295bf6a4545fede47 Apr 20 16:09:23 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-237285916 Apr 20 16:09:23 user devstack@n-api.service[61518]: X-User: tempest-ServerRescueNegativeTestJSON-237285916-project-member Apr 20 16:09:23 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:09:23 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:09:23 user devstack@n-api.service[61518]: X-User-Id: e51e637e06d1475692c4055ae99121da Apr 20 16:09:23 user devstack@n-api.service[61518]: X-User-Name: tempest-ServerRescueNegativeTestJSON-237285916-project-member Apr 20 16:09:23 user devstack@n-api.service[61518]: method: > Apr 20 16:09:23 user devstack@n-api.service[61518]: exception: Instance fe0bde76-a4f8-4865-91af-2bd3790587a7 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61518]: action_args: {'id': 'fe0bde76-a4f8-4865-91af-2bd3790587a7'} Apr 20 16:09:23 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0bde76-a4f8-4865-91af-2bd3790587a7 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0bde76-a4f8-4865-91af-2bd3790587a7 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0bde76-a4f8-4865-91af-2bd3790587a7 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Returning 404 to user: Instance fe0bde76-a4f8-4865-91af-2bd3790587a7 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:09:23 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-4c3dd027-a81d-420d-9d3c-75215aaa8567 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7" status: 404 len: 111 microversion: 2.1 time: 0.190342 Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:23 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 98/296] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:23 2023] GET /compute/v2.1/servers/fe0bde76-a4f8-4865-91af-2bd3790587a7 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: e8f62d46-e2dc-4870-adf1-f62d88bb653b] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:23 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] HTTP exception thrown: Instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Request method failure captured: Apr 20 16:09:23 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854 HTTP/1.1 Apr 20 16:09:23 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:09:23 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:09:23 user devstack@n-api.service[61517]: Connection: close Apr 20 16:09:23 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:09:23 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:09:23 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:09:23 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:09:23 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWJbl2VOQQoy_3bIWrKVQqbJOePNHfa-iDss8-FSv-dH_p43hMpaWTvwO6OJk40c9-OJH1fUz526ZzgBQ4IaxB0UOMbgNM1kB6owvJFa8oYHSKOO-GIbd0LGXZO4tZQBf0QyXM6OrBtt1Ns4T8tI4mcHLj2xSTWoxXcFf_m9h8th3pY Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Project-Id: a92cea9e1182477ca669c506b42eda60 Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Project-Name: tempest-VolumesAdminNegativeTest-978356230 Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92cea9e1182477ca669c506b42eda60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92cea9e1182477ca669c506b42eda60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92cea9e1182477ca669c506b42eda60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Tenant: tempest-VolumesAdminNegativeTest-978356230 Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Tenant-Id: a92cea9e1182477ca669c506b42eda60 Apr 20 16:09:23 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-978356230 Apr 20 16:09:23 user devstack@n-api.service[61517]: X-User: tempest-VolumesAdminNegativeTest-978356230-project-member Apr 20 16:09:23 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:09:23 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:09:23 user devstack@n-api.service[61517]: X-User-Id: c92692a1d38b4531a4e7f42660a54c7b Apr 20 16:09:23 user devstack@n-api.service[61517]: X-User-Name: tempest-VolumesAdminNegativeTest-978356230-project-member Apr 20 16:09:23 user devstack@n-api.service[61517]: method: > Apr 20 16:09:23 user devstack@n-api.service[61517]: exception: Instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61517]: action_args: {'id': 'dc918ed4-8bc6-4a4f-a189-d6cdd5817854'} Apr 20 16:09:23 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 could not be found. Apr 20 16:09:23 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:09:23 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Returning 404 to user: Instance dc918ed4-8bc6-4a4f-a189-d6cdd5817854 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:09:23 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-820c7917-8b8e-4639-ba78-2e06a5f72097 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854" status: 404 len: 111 microversion: 2.1 time: 0.202051 Apr 20 16:09:23 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:23 2023] GET /compute/v2.1/servers/dc918ed4-8bc6-4a4f-a189-d6cdd5817854 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:09:23 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-73e4ca03-10e8-4c93-9c61-7cea3dba3f12 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] Calling method '.version_select at 0x7f55879d56c0>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:23 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: e8f62d46-e2dc-4870-adf1-f62d88bb653b] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:09:23 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-73e4ca03-10e8-4c93-9c61-7cea3dba3f12 tempest-VolumesAdminNegativeTest-978356230 tempest-VolumesAdminNegativeTest-978356230-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405486078" status: 202 len: 0 microversion: 2.1 time: 0.019746 Apr 20 16:09:23 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 16:09:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405486078 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:09:24 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-13d0846d-7649-4508-9305-968e0510edd1 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b" status: 204 len: 0 microversion: 2.1 time: 0.122045 Apr 20 16:09:24 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 100/299] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:09:23 2023] DELETE /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: e8f62d46-e2dc-4870-adf1-f62d88bb653b] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:24 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51e637e06d1475692c4055ae99121da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4a73ba128147f295bf6a4545fede47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:09:24 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-6650c4cb-ccfe-460d-8615-f86458bb8a79 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b" status: 200 len: 1510 microversion: 2.1 time: 0.276915 Apr 20 16:09:24 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:24 2023] GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:09:24 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-7befd85a-ff75-4cd0-a053-551b27ef3074 req-ae2060fc-a67f-4393-9fb9-90a29e933b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f62d46-e2dc-4870-adf1-f62d88bb653b", "name": "network-vif-unplugged", "status": "completed", "tag": "8200d42f-0f8f-439d-8ea8-1eea4fba54d6"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:09:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-7befd85a-ff75-4cd0-a053-551b27ef3074 req-ae2060fc-a67f-4393-9fb9-90a29e933b6d service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-7befd85a-ff75-4cd0-a053-551b27ef3074 req-ae2060fc-a67f-4393-9fb9-90a29e933b6d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:24 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-7befd85a-ff75-4cd0-a053-551b27ef3074 req-ae2060fc-a67f-4393-9fb9-90a29e933b6d service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:24 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-7befd85a-ff75-4cd0-a053-551b27ef3074 req-ae2060fc-a67f-4393-9fb9-90a29e933b6d service nova] Creating event network-vif-unplugged:8200d42f-0f8f-439d-8ea8-1eea4fba54d6 for instance e8f62d46-e2dc-4870-adf1-f62d88bb653b on user Apr 20 16:09:24 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-7befd85a-ff75-4cd0-a053-551b27ef3074 req-ae2060fc-a67f-4393-9fb9-90a29e933b6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030383 Apr 20 16:09:24 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 100/301] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:09:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:09:25 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-20cc6a2d-ea00-425a-9e9e-4edade0bfd4d req-bdc020d8-b104-43df-aee7-56d72e4b4330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f62d46-e2dc-4870-adf1-f62d88bb653b", "name": "network-vif-deleted", "tag": "8200d42f-0f8f-439d-8ea8-1eea4fba54d6"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:09:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-20cc6a2d-ea00-425a-9e9e-4edade0bfd4d req-bdc020d8-b104-43df-aee7-56d72e4b4330 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-20cc6a2d-ea00-425a-9e9e-4edade0bfd4d req-bdc020d8-b104-43df-aee7-56d72e4b4330 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:25 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-20cc6a2d-ea00-425a-9e9e-4edade0bfd4d req-bdc020d8-b104-43df-aee7-56d72e4b4330 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:25 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-20cc6a2d-ea00-425a-9e9e-4edade0bfd4d req-bdc020d8-b104-43df-aee7-56d72e4b4330 service nova] Creating event network-vif-deleted:8200d42f-0f8f-439d-8ea8-1eea4fba54d6 for instance e8f62d46-e2dc-4870-adf1-f62d88bb653b on user Apr 20 16:09:25 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-20cc6a2d-ea00-425a-9e9e-4edade0bfd4d req-bdc020d8-b104-43df-aee7-56d72e4b4330 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035119 Apr 20 16:09:25 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 101/302] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:09:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 16:09:26 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-662c3a56-1c28-49ac-94eb-ead3e1ef73ea req-9d078075-b66a-441d-bca6-e3a981bc4666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f62d46-e2dc-4870-adf1-f62d88bb653b", "name": "network-vif-plugged", "status": "completed", "tag": "8200d42f-0f8f-439d-8ea8-1eea4fba54d6"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:09:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-662c3a56-1c28-49ac-94eb-ead3e1ef73ea req-9d078075-b66a-441d-bca6-e3a981bc4666 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-662c3a56-1c28-49ac-94eb-ead3e1ef73ea req-9d078075-b66a-441d-bca6-e3a981bc4666 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-662c3a56-1c28-49ac-94eb-ead3e1ef73ea req-9d078075-b66a-441d-bca6-e3a981bc4666 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:26 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-662c3a56-1c28-49ac-94eb-ead3e1ef73ea req-9d078075-b66a-441d-bca6-e3a981bc4666 service nova] Creating event network-vif-plugged:8200d42f-0f8f-439d-8ea8-1eea4fba54d6 for instance e8f62d46-e2dc-4870-adf1-f62d88bb653b on user Apr 20 16:09:26 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-662c3a56-1c28-49ac-94eb-ead3e1ef73ea req-9d078075-b66a-441d-bca6-e3a981bc4666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027796 Apr 20 16:09:26 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 102/303] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:09:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:09:27 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:27 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:28 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:28 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:09:28 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-cf75d64b-103f-40a5-a8d4-db9491462aee tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 200 len: 1494 microversion: 2.1 time: 0.239393 Apr 20 16:09:28 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 101/304] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:27 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:36 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:09:36 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-09f79422-62e9-4bad-9152-bb637373e6d9 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.243895 Apr 20 16:09:36 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 102/305] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:36 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=10 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=14 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] [instance: 4f841186-7958-4642-9050-9b048b61ebbb] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:45 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] [instance: 4f841186-7958-4642-9050-9b048b61ebbb] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:09:45 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-11904068-9727-4a8c-9102-2b81b52d85b9 tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb" status: 204 len: 0 microversion: 2.1 time: 0.118133 Apr 20 16:09:45 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:09:45 2023] DELETE /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] [instance: 4f841186-7958-4642-9050-9b048b61ebbb] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=12 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:45 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-c8d5e0a9-9d27-4bb7-92e9-89c447d3a868 req-64add8bb-558e-423a-80d6-22daf8610cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f841186-7958-4642-9050-9b048b61ebbb", "name": "network-vif-unplugged", "status": "completed", "tag": "fe7ac99b-2b51-4ae2-9903-9ae286328c8b"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:09:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-c8d5e0a9-9d27-4bb7-92e9-89c447d3a868 req-64add8bb-558e-423a-80d6-22daf8610cb9 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-c8d5e0a9-9d27-4bb7-92e9-89c447d3a868 req-64add8bb-558e-423a-80d6-22daf8610cb9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:45 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-c8d5e0a9-9d27-4bb7-92e9-89c447d3a868 req-64add8bb-558e-423a-80d6-22daf8610cb9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:45 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-c8d5e0a9-9d27-4bb7-92e9-89c447d3a868 req-64add8bb-558e-423a-80d6-22daf8610cb9 service nova] Creating event network-vif-unplugged:fe7ac99b-2b51-4ae2-9903-9ae286328c8b for instance 4f841186-7958-4642-9050-9b048b61ebbb on user Apr 20 16:09:45 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-c8d5e0a9-9d27-4bb7-92e9-89c447d3a868 req-64add8bb-558e-423a-80d6-22daf8610cb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032798 Apr 20 16:09:45 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 103/307] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:09:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:09:45 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403bee038ece4e9aa023aad83ee8f188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec92faae7a5d40f98409e9634a9dbf9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:09:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-f81f6c99-0fca-4634-a57a-aebdcecfa72e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb" status: 200 len: 1491 microversion: 2.1 time: 0.438917 Apr 20 16:09:45 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 102/308] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:09:45 2023] GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb => generated 1491 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:09:46 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-a4dd685e-85aa-4ecc-ab3e-fc6d47d88056 req-b93ae442-a6ae-4eeb-bfea-6438f1790c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f841186-7958-4642-9050-9b048b61ebbb", "name": "network-vif-deleted", "tag": "fe7ac99b-2b51-4ae2-9903-9ae286328c8b"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:09:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a4dd685e-85aa-4ecc-ab3e-fc6d47d88056 req-b93ae442-a6ae-4eeb-bfea-6438f1790c21 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a4dd685e-85aa-4ecc-ab3e-fc6d47d88056 req-b93ae442-a6ae-4eeb-bfea-6438f1790c21 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:46 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-a4dd685e-85aa-4ecc-ab3e-fc6d47d88056 req-b93ae442-a6ae-4eeb-bfea-6438f1790c21 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:46 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-a4dd685e-85aa-4ecc-ab3e-fc6d47d88056 req-b93ae442-a6ae-4eeb-bfea-6438f1790c21 service nova] Creating event network-vif-deleted:fe7ac99b-2b51-4ae2-9903-9ae286328c8b for instance 4f841186-7958-4642-9050-9b048b61ebbb on user Apr 20 16:09:46 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-a4dd685e-85aa-4ecc-ab3e-fc6d47d88056 req-b93ae442-a6ae-4eeb-bfea-6438f1790c21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029939 Apr 20 16:09:46 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 104/309] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:09:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:09:47 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-e4b13943-a77c-46e9-9349-ef51c54b5031 req-3d5ce21d-f880-4b56-9882-89779bc314b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f841186-7958-4642-9050-9b048b61ebbb", "name": "network-vif-plugged", "status": "completed", "tag": "fe7ac99b-2b51-4ae2-9903-9ae286328c8b"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:09:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e4b13943-a77c-46e9-9349-ef51c54b5031 req-3d5ce21d-f880-4b56-9882-89779bc314b4 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:09:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e4b13943-a77c-46e9-9349-ef51c54b5031 req-3d5ce21d-f880-4b56-9882-89779bc314b4 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:09:47 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e4b13943-a77c-46e9-9349-ef51c54b5031 req-3d5ce21d-f880-4b56-9882-89779bc314b4 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:09:47 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-e4b13943-a77c-46e9-9349-ef51c54b5031 req-3d5ce21d-f880-4b56-9882-89779bc314b4 service nova] Creating event network-vif-plugged:fe7ac99b-2b51-4ae2-9903-9ae286328c8b for instance 4f841186-7958-4642-9050-9b048b61ebbb on user Apr 20 16:09:47 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-e4b13943-a77c-46e9-9349-ef51c54b5031 req-3d5ce21d-f880-4b56-9882-89779bc314b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027355 Apr 20 16:09:47 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:09:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] [instance: e8f62d46-e2dc-4870-adf1-f62d88bb653b] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:14 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] HTTP exception thrown: Instance e8f62d46-e2dc-4870-adf1-f62d88bb653b could not be found. Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Request method failure captured: Apr 20 16:10:14 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b HTTP/1.1 Apr 20 16:10:14 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:10:14 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:10:14 user devstack@n-api.service[61518]: Connection: close Apr 20 16:10:14 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:10:14 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:10:14 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:10:14 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:10:14 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWJhcALwfSrIg_1H8aiI4fsrLQ3AduFxNI2UTQtXuNk8K1hPB3sthtC9ejeFX0qkUCZ__vRWqcWjQYmdp7Na8gFzKBKSeWJLyUa5hfFJ4yxCTTGXHunsRIJRhODg2xEeJmFNjuf3M5kUPWm-newujEjOlolyyJ79PUGPANfThb1XHEg Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Project-Id: 1d4a73ba128147f295bf6a4545fede47 Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-237285916 Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1d4a73ba128147f295bf6a4545fede47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d4a73ba128147f295bf6a4545fede47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1d4a73ba128147f295bf6a4545fede47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Tenant: tempest-ServerRescueNegativeTestJSON-237285916 Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Tenant-Id: 1d4a73ba128147f295bf6a4545fede47 Apr 20 16:10:14 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-237285916 Apr 20 16:10:14 user devstack@n-api.service[61518]: X-User: tempest-ServerRescueNegativeTestJSON-237285916-project-member Apr 20 16:10:14 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:10:14 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:10:14 user devstack@n-api.service[61518]: X-User-Id: e51e637e06d1475692c4055ae99121da Apr 20 16:10:14 user devstack@n-api.service[61518]: X-User-Name: tempest-ServerRescueNegativeTestJSON-237285916-project-member Apr 20 16:10:14 user devstack@n-api.service[61518]: method: > Apr 20 16:10:14 user devstack@n-api.service[61518]: exception: Instance e8f62d46-e2dc-4870-adf1-f62d88bb653b could not be found. Apr 20 16:10:14 user devstack@n-api.service[61518]: action_args: {'id': 'e8f62d46-e2dc-4870-adf1-f62d88bb653b'} Apr 20 16:10:14 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f62d46-e2dc-4870-adf1-f62d88bb653b could not be found. Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f62d46-e2dc-4870-adf1-f62d88bb653b could not be found. Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f62d46-e2dc-4870-adf1-f62d88bb653b could not be found. Apr 20 16:10:14 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:10:14 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] Returning 404 to user: Instance e8f62d46-e2dc-4870-adf1-f62d88bb653b could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:10:14 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-0491981d-070f-44e8-96ac-96decd6ef0d8 tempest-ServerRescueNegativeTestJSON-237285916 tempest-ServerRescueNegativeTestJSON-237285916-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b" status: 404 len: 111 microversion: 2.1 time: 0.032331 Apr 20 16:10:14 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 103/311] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:10:14 2023] GET /compute/v2.1/servers/e8f62d46-e2dc-4870-adf1-f62d88bb653b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:18 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:19 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-43ef5b51-2a1b-469f-b066-92ffe78b9a36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.179424 Apr 20 16:10:19 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 16:10:18 2023] GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f/os-interface => generated 283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:10:19 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:19 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=10 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:19 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-e9ecf419-0596-4461-8de4-853325e2665e req-008ab4f6-efed-4543-bb3f-1cf07fdb460c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d19a54-ca7e-46fc-af21-6a7ddbc6604f", "tag": "9223f738-4299-44ed-8e8f-c39e3353e39d"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:10:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e9ecf419-0596-4461-8de4-853325e2665e req-008ab4f6-efed-4543-bb3f-1cf07fdb460c service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e9ecf419-0596-4461-8de4-853325e2665e req-008ab4f6-efed-4543-bb3f-1cf07fdb460c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-e9ecf419-0596-4461-8de4-853325e2665e req-008ab4f6-efed-4543-bb3f-1cf07fdb460c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:19 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-e9ecf419-0596-4461-8de4-853325e2665e req-008ab4f6-efed-4543-bb3f-1cf07fdb460c service nova] Creating event network-changed:9223f738-4299-44ed-8e8f-c39e3353e39d for instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f on user Apr 20 16:10:19 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-e9ecf419-0596-4461-8de4-853325e2665e req-008ab4f6-efed-4543-bb3f-1cf07fdb460c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037968 Apr 20 16:10:19 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:10:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:19 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:20 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-a2e2a019-0669-44e7-9da6-93b514d84187 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f/ips" status: 200 len: 108 microversion: 2.1 time: 0.039171 Apr 20 16:10:20 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 104/314] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:10:19 2023] GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:21 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:10:21 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-77e4714d-2df6-4f6e-bddc-fa07b761b845 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f" status: 204 len: 0 microversion: 2.1 time: 0.127685 Apr 20 16:10:21 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:10:21 2023] DELETE /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:21 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690c49feae904687826fb959ba5ba283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cf2664111f45788d24092e8ceede9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:10:21 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-6f4fba1f-d745-42be-a7eb-8d4e4330b2c2 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f" status: 200 len: 1668 microversion: 2.1 time: 0.187213 Apr 20 16:10:21 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:10:21 2023] GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:10:21 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-d1a04897-742a-4b42-8603-260c023b3b04 req-100786de-c454-4cf8-950d-74eff3524d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d19a54-ca7e-46fc-af21-6a7ddbc6604f", "name": "network-vif-unplugged", "status": "completed", "tag": "9223f738-4299-44ed-8e8f-c39e3353e39d"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:10:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-d1a04897-742a-4b42-8603-260c023b3b04 req-100786de-c454-4cf8-950d-74eff3524d11 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-d1a04897-742a-4b42-8603-260c023b3b04 req-100786de-c454-4cf8-950d-74eff3524d11 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-d1a04897-742a-4b42-8603-260c023b3b04 req-100786de-c454-4cf8-950d-74eff3524d11 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:21 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-d1a04897-742a-4b42-8603-260c023b3b04 req-100786de-c454-4cf8-950d-74eff3524d11 service nova] Creating event network-vif-unplugged:9223f738-4299-44ed-8e8f-c39e3353e39d for instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f on user Apr 20 16:10:21 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-d1a04897-742a-4b42-8603-260c023b3b04 req-100786de-c454-4cf8-950d-74eff3524d11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034121 Apr 20 16:10:21 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 105/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:10:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:10:23 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-11036519-df74-4a0e-891a-d3e44962d6d3 req-dd7064d1-561a-4ddd-befd-02ddffeac652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d19a54-ca7e-46fc-af21-6a7ddbc6604f", "name": "network-vif-deleted", "tag": "9223f738-4299-44ed-8e8f-c39e3353e39d"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:10:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-11036519-df74-4a0e-891a-d3e44962d6d3 req-dd7064d1-561a-4ddd-befd-02ddffeac652 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-11036519-df74-4a0e-891a-d3e44962d6d3 req-dd7064d1-561a-4ddd-befd-02ddffeac652 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:23 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-11036519-df74-4a0e-891a-d3e44962d6d3 req-dd7064d1-561a-4ddd-befd-02ddffeac652 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:23 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-11036519-df74-4a0e-891a-d3e44962d6d3 req-dd7064d1-561a-4ddd-befd-02ddffeac652 service nova] Creating event network-vif-deleted:9223f738-4299-44ed-8e8f-c39e3353e39d for instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f on user Apr 20 16:10:23 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-11036519-df74-4a0e-891a-d3e44962d6d3 req-dd7064d1-561a-4ddd-befd-02ddffeac652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028876 Apr 20 16:10:23 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:10:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:10:23 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-3fdd4c96-3777-4fa0-a0e8-d481c4111bde req-5ab0b75e-9a8f-4a23-b3b5-0324ee675dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d19a54-ca7e-46fc-af21-6a7ddbc6604f", "name": "network-vif-plugged", "status": "completed", "tag": "9223f738-4299-44ed-8e8f-c39e3353e39d"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:10:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-3fdd4c96-3777-4fa0-a0e8-d481c4111bde req-5ab0b75e-9a8f-4a23-b3b5-0324ee675dbe service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-3fdd4c96-3777-4fa0-a0e8-d481c4111bde req-5ab0b75e-9a8f-4a23-b3b5-0324ee675dbe service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:23 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-3fdd4c96-3777-4fa0-a0e8-d481c4111bde req-5ab0b75e-9a8f-4a23-b3b5-0324ee675dbe service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:23 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-3fdd4c96-3777-4fa0-a0e8-d481c4111bde req-5ab0b75e-9a8f-4a23-b3b5-0324ee675dbe service nova] Creating event network-vif-plugged:9223f738-4299-44ed-8e8f-c39e3353e39d for instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f on user Apr 20 16:10:23 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-3fdd4c96-3777-4fa0-a0e8-d481c4111bde req-5ab0b75e-9a8f-4a23-b3b5-0324ee675dbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027938 Apr 20 16:10:23 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 107/319] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:10:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:29 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:10:29 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-79e65542-585e-4d54-a7f0-e4e51fa6e68c tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 200 len: 1494 microversion: 2.1 time: 0.260444 Apr 20 16:10:29 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 106/320] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:10:29 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 1494 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] [instance: 4f841186-7958-4642-9050-9b048b61ebbb] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] HTTP exception thrown: Instance 4f841186-7958-4642-9050-9b048b61ebbb could not be found. Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Request method failure captured: Apr 20 16:10:35 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb HTTP/1.1 Apr 20 16:10:35 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:10:35 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:10:35 user devstack@n-api.service[61517]: Connection: close Apr 20 16:10:35 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:10:35 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:10:35 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:10:35 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:10:35 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWNWU1HFheua-Vcy4Yc6WQhYcJO_jfGSOX1i1UnDI1G8BQzF2_J9vW5_s3nB2eJwS6RNFWHfuTdbhHowOjMH_8QPJ-6ifTjADaTnWMpFrV_-PKz5UB2o4YZ-_uo_31Lof6Cf3Qs_aDzE6zl2wb79E8Wb9N2_8mFyPB7u8zk-Y2gHmqQ Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Project-Id: ec92faae7a5d40f98409e9634a9dbf9b Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Project-Name: tempest-VolumesActionsTest-1745644681 Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec92faae7a5d40f98409e9634a9dbf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec92faae7a5d40f98409e9634a9dbf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec92faae7a5d40f98409e9634a9dbf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Tenant: tempest-VolumesActionsTest-1745644681 Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Tenant-Id: ec92faae7a5d40f98409e9634a9dbf9b Apr 20 16:10:35 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-VolumesActionsTest-1745644681 Apr 20 16:10:35 user devstack@n-api.service[61517]: X-User: tempest-VolumesActionsTest-1745644681-project-member Apr 20 16:10:35 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:10:35 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:10:35 user devstack@n-api.service[61517]: X-User-Id: 403bee038ece4e9aa023aad83ee8f188 Apr 20 16:10:35 user devstack@n-api.service[61517]: X-User-Name: tempest-VolumesActionsTest-1745644681-project-member Apr 20 16:10:35 user devstack@n-api.service[61517]: method: > Apr 20 16:10:35 user devstack@n-api.service[61517]: exception: Instance 4f841186-7958-4642-9050-9b048b61ebbb could not be found. Apr 20 16:10:35 user devstack@n-api.service[61517]: action_args: {'id': '4f841186-7958-4642-9050-9b048b61ebbb'} Apr 20 16:10:35 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f841186-7958-4642-9050-9b048b61ebbb could not be found. Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f841186-7958-4642-9050-9b048b61ebbb could not be found. Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f841186-7958-4642-9050-9b048b61ebbb could not be found. Apr 20 16:10:35 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:10:35 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] Returning 404 to user: Instance 4f841186-7958-4642-9050-9b048b61ebbb could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:10:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ba14660a-d8dd-4ef5-a84c-5938d110fb8e tempest-VolumesActionsTest-1745644681 tempest-VolumesActionsTest-1745644681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb" status: 404 len: 111 microversion: 2.1 time: 0.035163 Apr 20 16:10:35 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 108/321] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:10:35 2023] GET /compute/v2.1/servers/4f841186-7958-4642-9050-9b048b61ebbb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=10 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:36 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:10:36 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-48a663f9-961f-414e-9dee-ec97707b457a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.218843 Apr 20 16:10:36 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 108/322] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:10:36 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:37 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:10:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-35a770b1-7380-4bc8-b303-911216bca32a tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.214606 Apr 20 16:10:37 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 107/323] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:10:36 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:10:37 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:10:37 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-7dd5e1c6-dff3-475a-beae-320cc35a7e45 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.135173 Apr 20 16:10:37 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:10:37 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:11:06 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:06 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:06 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-d05c116c-9f8e-4ab3-b6ab-b501549206f5 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Action: 'create', calling method: .version_select at 0x7f5588ffc310>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1504266769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7kqNWnEn2hJiKbn+roVzFAUQv+vrvS2keY49vWi3kz6H/X1mSRhv0lb/LsmmiG61nDcYpkJebf4uXL/6YHuVK1fQRP8/2MwnEkEV1Hk939UStYtsqYSVjo2UDwQtWlYg=="}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:06 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-d05c116c-9f8e-4ab3-b6ab-b501549206f5 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Getting quotas for project 3cc4f384caf14fb3baff01938400bb4b. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:11:06 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-d05c116c-9f8e-4ab3-b6ab-b501549206f5 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Getting quotas for user 851a3140769443e4b62b73b987e2b417 and project 3cc4f384caf14fb3baff01938400bb4b. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:11:06 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-d05c116c-9f8e-4ab3-b6ab-b501549206f5 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.265452 Apr 20 16:11:06 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 109/325] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:11:06 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:11:07 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=10 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:07 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=20 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:07 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-771415346", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1504266769", "security_groups": [{"name": "tempest-secgroup-smoke-611462111"}], "networks": [{"uuid": "9ac82ace-9d10-48a7-8d31-7e6637f442b4"}]}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:07 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] validate_networks() for [('9ac82ace-9d10-48a7-8d31-7e6637f442b4', None, None, None, None, None)] {{(pid=61518) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Flavor limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Image limits 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Flavor pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Image pref 0:0:0 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.virt.hardware [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Getting quotas for project 3cc4f384caf14fb3baff01938400bb4b. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Getting quotas for user 851a3140769443e4b62b73b987e2b417 and project 3cc4f384caf14fb3baff01938400bb4b. Resources: {'cores', 'instances', 'ram'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Going to run 1 instances... {{(pid=61518) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:11:08 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:11:08 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-c669bb97-0988-4237-ba99-55abe29e5c3d tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.975770 Apr 20 16:11:08 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 108/326] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:11:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:11:08 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-35e6e5de-3d7d-40d8-9ebf-31fada6885a4 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:08 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-35e6e5de-3d7d-40d8-9ebf-31fada6885a4 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:08 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:08 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=8 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:08 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-35e6e5de-3d7d-40d8-9ebf-31fada6885a4 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851a3140769443e4b62b73b987e2b417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc4f384caf14fb3baff01938400bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:11:08 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-35e6e5de-3d7d-40d8-9ebf-31fada6885a4 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2" status: 200 len: 1256 microversion: 2.1 time: 0.070262 Apr 20 16:11:08 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:08 2023] GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2 => generated 1256 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:11:10 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-064621c4-536b-4b6f-96ab-5613f99cbf9c req-e80ac663-728e-4d59-b270-58cb411b1859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6766bf80-e99c-4363-b229-84049f21b1a2", "tag": "6ee15985-c252-4270-ad30-f6f5efe94b86"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:10 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-064621c4-536b-4b6f-96ab-5613f99cbf9c req-e80ac663-728e-4d59-b270-58cb411b1859 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:10 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-064621c4-536b-4b6f-96ab-5613f99cbf9c req-e80ac663-728e-4d59-b270-58cb411b1859 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:10 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-064621c4-536b-4b6f-96ab-5613f99cbf9c req-e80ac663-728e-4d59-b270-58cb411b1859 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:10 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-064621c4-536b-4b6f-96ab-5613f99cbf9c req-e80ac663-728e-4d59-b270-58cb411b1859 service nova] Creating event network-changed:6ee15985-c252-4270-ad30-f6f5efe94b86 for instance 6766bf80-e99c-4363-b229-84049f21b1a2 on user Apr 20 16:11:10 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-064621c4-536b-4b6f-96ab-5613f99cbf9c req-e80ac663-728e-4d59-b270-58cb411b1859 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029335 Apr 20 16:11:10 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 110/328] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:11 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:11:11 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f HTTP/1.1 Apr 20 16:11:11 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:11:11 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:11:11 user devstack@n-api.service[61518]: Connection: close Apr 20 16:11:11 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:11:11 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:11:11 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:11:11 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:11:11 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:11 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:11 user devstack@n-api.service[61518]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:11 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:11:11 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:11:11 user devstack@n-api.service[61518]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:11:11 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:11 user devstack@n-api.service[61518]: method: > Apr 20 16:11:11 user devstack@n-api.service[61518]: exception: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:11 user devstack@n-api.service[61518]: action_args: {'id': 'f6d19a54-ca7e-46fc-af21-6a7ddbc6604f'} Apr 20 16:11:11 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:11 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:11 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:11 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-028ebb3a-2e98-4b89-99e4-92f96c31413a tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f" status: 404 len: 111 microversion: 2.1 time: 0.034396 Apr 20 16:11:11 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 109/329] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:11 2023] GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:11 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-800f2123-09b2-4ddf-8b0d-8babd988c76e tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '.version_select at 0x7f558782db40>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:11 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-800f2123-09b2-4ddf-8b0d-8babd988c76e tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627338015" status: 202 len: 0 microversion: 2.1 time: 0.023514 Apr 20 16:11:11 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 16:11:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627338015 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:11:12 user devstack@n-api.service[61519]: request: DELETE /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f HTTP/1.1 Apr 20 16:11:12 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:11:12 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:11:12 user devstack@n-api.service[61519]: Connection: close Apr 20 16:11:12 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:11:12 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:11:12 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:11:12 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:11:12 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61519]: method: > Apr 20 16:11:12 user devstack@n-api.service[61519]: exception: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: action_args: {'id': 'f6d19a54-ca7e-46fc-af21-6a7ddbc6604f'} Apr 20 16:11:12 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:12 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-7f0508bc-61f7-42eb-a6a4-d43b7acf9951 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f" status: 404 len: 111 microversion: 2.1 time: 0.026494 Apr 20 16:11:12 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 111/331] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:11:12 2023] DELETE /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: f6d19a54-ca7e-46fc-af21-6a7ddbc6604f] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:11:12 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f HTTP/1.1 Apr 20 16:11:12 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:11:12 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:11:12 user devstack@n-api.service[61518]: Connection: close Apr 20 16:11:12 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:11:12 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:11:12 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:11:12 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:11:12 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61518]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61518]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:11:12 user devstack@n-api.service[61518]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61518]: method: > Apr 20 16:11:12 user devstack@n-api.service[61518]: exception: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61518]: action_args: {'id': 'f6d19a54-ca7e-46fc-af21-6a7ddbc6604f'} Apr 20 16:11:12 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. Apr 20 16:11:12 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance f6d19a54-ca7e-46fc-af21-6a7ddbc6604f could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:12 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-3c1ae69c-ff97-4f02-8061-9ca0df1a9f0b tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f" status: 404 len: 111 microversion: 2.1 time: 0.029094 Apr 20 16:11:12 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 110/332] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:12 2023] GET /compute/v2.1/servers/f6d19a54-ca7e-46fc-af21-6a7ddbc6604f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:11:12 user devstack@n-api.service[61517]: request: DELETE /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a HTTP/1.1 Apr 20 16:11:12 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:11:12 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:11:12 user devstack@n-api.service[61517]: Connection: close Apr 20 16:11:12 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:11:12 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:11:12 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:11:12 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:11:12 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61517]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61517]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:11:12 user devstack@n-api.service[61517]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61517]: method: > Apr 20 16:11:12 user devstack@n-api.service[61517]: exception: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61517]: action_args: {'id': 'c2b84ca2-f67b-4219-b7e6-18d2029e998a'} Apr 20 16:11:12 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:12 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-98ead492-fd51-44e6-82fb-4241ceb3bb36 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a" status: 404 len: 111 microversion: 2.1 time: 0.034207 Apr 20 16:11:12 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:11:12 2023] DELETE /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: c2b84ca2-f67b-4219-b7e6-18d2029e998a] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:11:12 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a HTTP/1.1 Apr 20 16:11:12 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:11:12 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:11:12 user devstack@n-api.service[61519]: Connection: close Apr 20 16:11:12 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:11:12 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:11:12 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:11:12 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:11:12 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:12 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:11:12 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:12 user devstack@n-api.service[61519]: method: > Apr 20 16:11:12 user devstack@n-api.service[61519]: exception: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: action_args: {'id': 'c2b84ca2-f67b-4219-b7e6-18d2029e998a'} Apr 20 16:11:12 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. Apr 20 16:11:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance c2b84ca2-f67b-4219-b7e6-18d2029e998a could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:12 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-e6ab66c7-ab94-42f5-9b15-4e4e2cad8690 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a" status: 404 len: 111 microversion: 2.1 time: 0.032043 Apr 20 16:11:12 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:12 2023] GET /compute/v2.1/servers/c2b84ca2-f67b-4219-b7e6-18d2029e998a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-6f334ffa-cc07-44d1-9ffc-6297da423708 req-4c214097-010c-46ce-9e4e-da7e07da31da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6766bf80-e99c-4363-b229-84049f21b1a2", "name": "network-vif-plugged", "status": "completed", "tag": "6ee15985-c252-4270-ad30-f6f5efe94b86"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-6f334ffa-cc07-44d1-9ffc-6297da423708 req-4c214097-010c-46ce-9e4e-da7e07da31da service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-6f334ffa-cc07-44d1-9ffc-6297da423708 req-4c214097-010c-46ce-9e4e-da7e07da31da service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:12 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-6f334ffa-cc07-44d1-9ffc-6297da423708 req-4c214097-010c-46ce-9e4e-da7e07da31da service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:12 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-6f334ffa-cc07-44d1-9ffc-6297da423708 req-4c214097-010c-46ce-9e4e-da7e07da31da service nova] Creating event network-vif-plugged:6ee15985-c252-4270-ad30-f6f5efe94b86 for instance 6766bf80-e99c-4363-b229-84049f21b1a2 on user Apr 20 16:11:12 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-6f334ffa-cc07-44d1-9ffc-6297da423708 req-4c214097-010c-46ce-9e4e-da7e07da31da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035495 Apr 20 16:11:12 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 111/335] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:13 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:11:13 user devstack@n-api.service[61517]: request: DELETE /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 HTTP/1.1 Apr 20 16:11:13 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:11:13 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:11:13 user devstack@n-api.service[61517]: Connection: close Apr 20 16:11:13 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:11:13 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:11:13 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:11:13 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:11:13 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:13 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:13 user devstack@n-api.service[61517]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:13 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:11:13 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:11:13 user devstack@n-api.service[61517]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:11:13 user devstack@n-api.service[61517]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:13 user devstack@n-api.service[61517]: method: > Apr 20 16:11:13 user devstack@n-api.service[61517]: exception: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61517]: action_args: {'id': 'a5e68386-3b32-458b-9808-797d041c2235'} Apr 20 16:11:13 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:13 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-18337dde-87fa-4f83-ab03-6ea4bd4ef8f6 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235" status: 404 len: 111 microversion: 2.1 time: 0.033259 Apr 20 16:11:13 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 113/336] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:11:13 2023] DELETE /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] [instance: a5e68386-3b32-458b-9808-797d041c2235] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:13 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] HTTP exception thrown: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Request method failure captured: Apr 20 16:11:13 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 HTTP/1.1 Apr 20 16:11:13 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:11:13 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:11:13 user devstack@n-api.service[61519]: Connection: close Apr 20 16:11:13 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:11:13 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:11:13 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:11:13 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:11:13 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWIgi7f_YZLkH3CbcVsZRp2s-4TEDWNDjid0DdlgPfREvyDIT_R23oBv73lDJxq-_RrFGuiHmSgYBL0ZWewv7H3q2ndflVHpsvkTkuN9EGb7Qp0texEUx9AV_NQq46GeXEypgFcYlWLPC1rYmEdntZmoElXcIsH_HKVXS_aPpRqDJzE Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Project-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Project-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71cf2664111f45788d24092e8ceede9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Tenant: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Tenant-Id: 71cf2664111f45788d24092e8ceede9c Apr 20 16:11:13 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-308436039 Apr 20 16:11:13 user devstack@n-api.service[61519]: X-User: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:13 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:11:13 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:11:13 user devstack@n-api.service[61519]: X-User-Id: 690c49feae904687826fb959ba5ba283 Apr 20 16:11:13 user devstack@n-api.service[61519]: X-User-Name: tempest-AttachVolumeNegativeTest-308436039-project-member Apr 20 16:11:13 user devstack@n-api.service[61519]: method: > Apr 20 16:11:13 user devstack@n-api.service[61519]: exception: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61519]: action_args: {'id': 'a5e68386-3b32-458b-9808-797d041c2235'} Apr 20 16:11:13 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. Apr 20 16:11:13 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:13 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] Returning 404 to user: Instance a5e68386-3b32-458b-9808-797d041c2235 could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:13 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-22c6196c-75a8-42bb-b741-38e5bf643916 tempest-AttachVolumeNegativeTest-308436039 tempest-AttachVolumeNegativeTest-308436039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235" status: 404 len: 111 microversion: 2.1 time: 0.028729 Apr 20 16:11:13 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:13 2023] GET /compute/v2.1/servers/a5e68386-3b32-458b-9808-797d041c2235 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 16:11:15 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-cceca842-3d3d-42e7-9635-4670b1e8c6a1 req-2fe5b254-ccf9-4614-bea7-23d22c93d3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6766bf80-e99c-4363-b229-84049f21b1a2", "name": "network-vif-plugged", "status": "completed", "tag": "6ee15985-c252-4270-ad30-f6f5efe94b86"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:15 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cceca842-3d3d-42e7-9635-4670b1e8c6a1 req-2fe5b254-ccf9-4614-bea7-23d22c93d3b3 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:15 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cceca842-3d3d-42e7-9635-4670b1e8c6a1 req-2fe5b254-ccf9-4614-bea7-23d22c93d3b3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:15 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cceca842-3d3d-42e7-9635-4670b1e8c6a1 req-2fe5b254-ccf9-4614-bea7-23d22c93d3b3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:15 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-cceca842-3d3d-42e7-9635-4670b1e8c6a1 req-2fe5b254-ccf9-4614-bea7-23d22c93d3b3 service nova] Creating event network-vif-plugged:6ee15985-c252-4270-ad30-f6f5efe94b86 for instance 6766bf80-e99c-4363-b229-84049f21b1a2 on user Apr 20 16:11:15 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-cceca842-3d3d-42e7-9635-4670b1e8c6a1 req-2fe5b254-ccf9-4614-bea7-23d22c93d3b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039262 Apr 20 16:11:15 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 112/338] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] HTTP exception thrown: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Request method failure captured: Apr 20 16:11:30 user devstack@n-api.service[61517]: request: DELETE /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 HTTP/1.1 Apr 20 16:11:30 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:11:30 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:11:30 user devstack@n-api.service[61517]: Connection: close Apr 20 16:11:30 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:11:30 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:11:30 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:11:30 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:11:30 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWIo2AFjK9eG4FPXNdvM7y0w3rHXpMDlETareP11qxnPua6l_xiHs5DzHRs39K90LFzTFqjvXY4iKpqzOLJYu9wD6xWpNrsUwm_bIjhDnH_11gcZ7hRm6cvcbD1a7qB4AbXDd9As6VYAZGCDAsbjrCryi7-2_EWtm-x3Ll0cghRYSx8 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Project-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Project-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Tenant: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Tenant-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-User: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:11:30 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:11:30 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:11:30 user devstack@n-api.service[61517]: X-User-Id: 9be25e958c6047068ab5ce63106b0754 Apr 20 16:11:30 user devstack@n-api.service[61517]: X-User-Name: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:11:30 user devstack@n-api.service[61517]: method: > Apr 20 16:11:30 user devstack@n-api.service[61517]: exception: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61517]: action_args: {'id': 'dd78d74a-11d6-4f06-8092-5088b3fad412'} Apr 20 16:11:30 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Returning 404 to user: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:30 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-b111c97d-47c2-4a3d-b6b9-834d943ede56 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412" status: 404 len: 111 microversion: 2.1 time: 0.033641 Apr 20 16:11:30 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 114/339] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:11:30 2023] DELETE /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: dd78d74a-11d6-4f06-8092-5088b3fad412] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=8 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] HTTP exception thrown: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Request method failure captured: Apr 20 16:11:30 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 HTTP/1.1 Apr 20 16:11:30 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:11:30 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:11:30 user devstack@n-api.service[61519]: Connection: close Apr 20 16:11:30 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:11:30 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:11:30 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:11:30 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:11:30 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWIo2AFjK9eG4FPXNdvM7y0w3rHXpMDlETareP11qxnPua6l_xiHs5DzHRs39K90LFzTFqjvXY4iKpqzOLJYu9wD6xWpNrsUwm_bIjhDnH_11gcZ7hRm6cvcbD1a7qB4AbXDd9As6VYAZGCDAsbjrCryi7-2_EWtm-x3Ll0cghRYSx8 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Project-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Project-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Tenant: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Tenant-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-User: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:11:30 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:11:30 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:11:30 user devstack@n-api.service[61519]: X-User-Id: 9be25e958c6047068ab5ce63106b0754 Apr 20 16:11:30 user devstack@n-api.service[61519]: X-User-Name: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:11:30 user devstack@n-api.service[61519]: method: > Apr 20 16:11:30 user devstack@n-api.service[61519]: exception: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61519]: action_args: {'id': 'dd78d74a-11d6-4f06-8092-5088b3fad412'} Apr 20 16:11:30 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. Apr 20 16:11:30 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Returning 404 to user: Instance dd78d74a-11d6-4f06-8092-5088b3fad412 could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:11:30 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-4510fc54-9b15-41e9-bb10-9b46b2f7dc30 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412" status: 404 len: 111 microversion: 2.1 time: 0.040623 Apr 20 16:11:30 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:30 2023] GET /compute/v2.1/servers/dd78d74a-11d6-4f06-8092-5088b3fad412 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=10 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:11:30 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-f62dd740-316f-415d-907a-d2d1a0a8acf4 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 204 len: 0 microversion: 2.1 time: 0.114748 Apr 20 16:11:30 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:11:30 2023] DELETE /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-b61016d1-9bd8-414c-840c-46bb8c02bda4 req-c082683b-abdf-4c4d-9e2d-5f16b4e42f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ea4d29-b178-4da2-b971-76f97031b244", "name": "network-vif-unplugged", "status": "completed", "tag": "0b36b1a4-9ab6-49cb-9a5e-afc32792783e"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b61016d1-9bd8-414c-840c-46bb8c02bda4 req-c082683b-abdf-4c4d-9e2d-5f16b4e42f38 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b61016d1-9bd8-414c-840c-46bb8c02bda4 req-c082683b-abdf-4c4d-9e2d-5f16b4e42f38 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:30 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-b61016d1-9bd8-414c-840c-46bb8c02bda4 req-c082683b-abdf-4c4d-9e2d-5f16b4e42f38 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:30 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-b61016d1-9bd8-414c-840c-46bb8c02bda4 req-c082683b-abdf-4c4d-9e2d-5f16b4e42f38 service nova] Creating event network-vif-unplugged:0b36b1a4-9ab6-49cb-9a5e-afc32792783e for instance d4ea4d29-b178-4da2-b971-76f97031b244 on user Apr 20 16:11:30 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-b61016d1-9bd8-414c-840c-46bb8c02bda4 req-c082683b-abdf-4c4d-9e2d-5f16b4e42f38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031489 Apr 20 16:11:30 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:11:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:11:30 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be25e958c6047068ab5ce63106b0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8444d3c8f554a56967917670b19dc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:11:30 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ecebb185-377e-47b7-b621-73d7ce8ebe13 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 200 len: 1500 microversion: 2.1 time: 0.357250 Apr 20 16:11:30 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 115/343] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:30 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 1500 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:11:31 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-cdbd0bb2-1072-4624-b7a1-a676f8962652 req-cc36dc29-76c9-4d43-b648-087a87d4e54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ea4d29-b178-4da2-b971-76f97031b244", "name": "network-vif-deleted", "tag": "0b36b1a4-9ab6-49cb-9a5e-afc32792783e"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cdbd0bb2-1072-4624-b7a1-a676f8962652 req-cc36dc29-76c9-4d43-b648-087a87d4e54a service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cdbd0bb2-1072-4624-b7a1-a676f8962652 req-cc36dc29-76c9-4d43-b648-087a87d4e54a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:31 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-cdbd0bb2-1072-4624-b7a1-a676f8962652 req-cc36dc29-76c9-4d43-b648-087a87d4e54a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:31 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-cdbd0bb2-1072-4624-b7a1-a676f8962652 req-cc36dc29-76c9-4d43-b648-087a87d4e54a service nova] Creating event network-vif-deleted:0b36b1a4-9ab6-49cb-9a5e-afc32792783e for instance d4ea4d29-b178-4da2-b971-76f97031b244 on user Apr 20 16:11:31 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-cdbd0bb2-1072-4624-b7a1-a676f8962652 req-cc36dc29-76c9-4d43-b648-087a87d4e54a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Apr 20 16:11:31 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:11:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:11:32 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-fa5e9bba-f351-46cc-944b-7ac7b620868a req-c2b09e7b-fa78-4073-8b78-67034443f8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ea4d29-b178-4da2-b971-76f97031b244", "name": "network-vif-plugged", "status": "completed", "tag": "0b36b1a4-9ab6-49cb-9a5e-afc32792783e"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:11:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-fa5e9bba-f351-46cc-944b-7ac7b620868a req-c2b09e7b-fa78-4073-8b78-67034443f8e5 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-fa5e9bba-f351-46cc-944b-7ac7b620868a req-c2b09e7b-fa78-4073-8b78-67034443f8e5 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-fa5e9bba-f351-46cc-944b-7ac7b620868a req-c2b09e7b-fa78-4073-8b78-67034443f8e5 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-fa5e9bba-f351-46cc-944b-7ac7b620868a req-c2b09e7b-fa78-4073-8b78-67034443f8e5 service nova] Creating event network-vif-plugged:0b36b1a4-9ab6-49cb-9a5e-afc32792783e for instance d4ea4d29-b178-4da2-b971-76f97031b244 on user Apr 20 16:11:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-fa5e9bba-f351-46cc-944b-7ac7b620868a req-c2b09e7b-fa78-4073-8b78-67034443f8e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028426 Apr 20 16:11:32 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 116/345] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:38 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:39 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:11:39 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-58611fd6-7a61-4dd4-9aac-cfbd9f8913d0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.242028 Apr 20 16:11:39 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:38 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:11:58 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:11:59 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851a3140769443e4b62b73b987e2b417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc4f384caf14fb3baff01938400bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:11:59 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-31e2573e-4818-41e6-8211-7945a529d16c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2" status: 200 len: 1565 microversion: 2.1 time: 0.252432 Apr 20 16:11:59 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:11:58 2023] GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2 => generated 1565 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] [instance: d4ea4d29-b178-4da2-b971-76f97031b244] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:20 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] HTTP exception thrown: Instance d4ea4d29-b178-4da2-b971-76f97031b244 could not be found. Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Request method failure captured: Apr 20 16:12:20 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 HTTP/1.1 Apr 20 16:12:20 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:12:20 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:12:20 user devstack@n-api.service[61519]: Connection: close Apr 20 16:12:20 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:12:20 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:12:20 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:12:20 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:12:20 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWIo2AFjK9eG4FPXNdvM7y0w3rHXpMDlETareP11qxnPua6l_xiHs5DzHRs39K90LFzTFqjvXY4iKpqzOLJYu9wD6xWpNrsUwm_bIjhDnH_11gcZ7hRm6cvcbD1a7qB4AbXDd9As6VYAZGCDAsbjrCryi7-2_EWtm-x3Ll0cghRYSx8 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Project-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Project-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8444d3c8f554a56967917670b19dc37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Tenant: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Tenant-Id: d8444d3c8f554a56967917670b19dc37 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-942369263 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-User: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:12:20 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:12:20 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:12:20 user devstack@n-api.service[61519]: X-User-Id: 9be25e958c6047068ab5ce63106b0754 Apr 20 16:12:20 user devstack@n-api.service[61519]: X-User-Name: tempest-ServersNegativeTestJSON-942369263-project-member Apr 20 16:12:20 user devstack@n-api.service[61519]: method: > Apr 20 16:12:20 user devstack@n-api.service[61519]: exception: Instance d4ea4d29-b178-4da2-b971-76f97031b244 could not be found. Apr 20 16:12:20 user devstack@n-api.service[61519]: action_args: {'id': 'd4ea4d29-b178-4da2-b971-76f97031b244'} Apr 20 16:12:20 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ea4d29-b178-4da2-b971-76f97031b244 could not be found. Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ea4d29-b178-4da2-b971-76f97031b244 could not be found. Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ea4d29-b178-4da2-b971-76f97031b244 could not be found. Apr 20 16:12:20 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:12:20 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] Returning 404 to user: Instance d4ea4d29-b178-4da2-b971-76f97031b244 could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:12:20 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-ab326aed-f887-4d7b-b1c5-341ea91f0750 tempest-ServersNegativeTestJSON-942369263 tempest-ServersNegativeTestJSON-942369263-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244" status: 404 len: 111 microversion: 2.1 time: 0.032235 Apr 20 16:12:20 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:12:20 2023] GET /compute/v2.1/servers/d4ea4d29-b178-4da2-b971-76f97031b244 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:12:24 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:24 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=14 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:25 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-c14d6cac-adb8-440b-8c73-ab9bb973453c tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] Action: 'create', calling method: .version_select at 0x7f55879f32e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-822047434", "metadata": {"Type": "work"}}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:12:25 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-c14d6cac-adb8-440b-8c73-ab9bb973453c tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.427570 Apr 20 16:12:25 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 117/349] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 16:12:24 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 429 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 16:12:25 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-cd8f010a-9f14-49b7-9b49-e02028a80623 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] Calling method '.version_select at 0x7f55879d69e0>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:25 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:25 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:25 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-cd8f010a-9f14-49b7-9b49-e02028a80623 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5" status: 200 len: 349 microversion: 2.1 time: 0.053824 Apr 20 16:12:25 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 116/350] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 16:12:25 2023] GET /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5 => generated 349 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:12:26 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-998fd29e-d7aa-4dfc-9681-4618a9273f11 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] Calling method '.version_select at 0x7f558785e5f0>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:26 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-998fd29e-d7aa-4dfc-9681-4618a9273f11 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5" status: 200 len: 349 microversion: 2.1 time: 0.056053 Apr 20 16:12:26 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 118/351] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 16:12:26 2023] GET /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5 => generated 349 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:12:26 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-c5332ed8-35b7-40eb-a3cd-ff00094c1f76 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] Calling method '.version_select at 0x7f558782d900>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:26 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-c5332ed8-35b7-40eb-a3cd-ff00094c1f76 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5" status: 202 len: 0 microversion: 2.1 time: 0.168121 Apr 20 16:12:26 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 16:12:26 2023] DELETE /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:12:26 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-cc8b864f-bb15-45b5-b820-10f12ebe25f4 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] Calling method '.version_select at 0x7f55879d6f80>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:26 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-cc8b864f-bb15-45b5-b820-10f12ebe25f4 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] HTTP exception thrown: Volume c5a78759-a08d-49ec-b116-b9b6a0a586b5 could not be found. Apr 20 16:12:26 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-cc8b864f-bb15-45b5-b820-10f12ebe25f4 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] Request method failure captured: Apr 20 16:12:26 user devstack@n-api.service[61518]: request: GET /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5 HTTP/1.1 Apr 20 16:12:26 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:12:26 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:12:26 user devstack@n-api.service[61518]: Connection: close Apr 20 16:12:26 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:12:26 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:12:26 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:12:26 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:12:26 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWRoqfbygFgb5ExWY_x3jfuf_2vcACTphjRZBGqobWpXg8KN7jybNfCs0mHN_nJDLs_giIkppLE95ev3afXp_6E-W4WGCzcSXMqVOcS88IU3w6FiZ0FaS8X0i8JumHg19HxUp3CicMDcgIzHI7p3r6h9SOOcSpWmvMbFVJkhKNqwqPo Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Project-Id: 7ee49c60ce234478b5d7249e5b80d8e7 Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Project-Name: tempest-VolumesGetTestJSON-177633402 Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ee49c60ce234478b5d7249e5b80d8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ee49c60ce234478b5d7249e5b80d8e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ee49c60ce234478b5d7249e5b80d8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Tenant: tempest-VolumesGetTestJSON-177633402 Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Tenant-Id: 7ee49c60ce234478b5d7249e5b80d8e7 Apr 20 16:12:26 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-VolumesGetTestJSON-177633402 Apr 20 16:12:26 user devstack@n-api.service[61518]: X-User: tempest-VolumesGetTestJSON-177633402-project-member Apr 20 16:12:26 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:12:26 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:12:26 user devstack@n-api.service[61518]: X-User-Id: 1ce746d0ec044e018b80f6a0801dbade Apr 20 16:12:26 user devstack@n-api.service[61518]: X-User-Name: tempest-VolumesGetTestJSON-177633402-project-member Apr 20 16:12:26 user devstack@n-api.service[61518]: method: Apr 20 16:12:26 user devstack@n-api.service[61518]: exception: Volume c5a78759-a08d-49ec-b116-b9b6a0a586b5 could not be found. Apr 20 16:12:26 user devstack@n-api.service[61518]: action_args: {'id': 'c5a78759-a08d-49ec-b116-b9b6a0a586b5'} Apr 20 16:12:26 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5a78759-a08d-49ec-b116-b9b6a0a586b5 could not be found. (HTTP 404) (Request-ID: req-e031268b-cd58-4250-9027-75f610957e7e) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5a78759-a08d-49ec-b116-b9b6a0a586b5 could not be found. Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5a78759-a08d-49ec-b116-b9b6a0a586b5 could not be found. Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5a78759-a08d-49ec-b116-b9b6a0a586b5 could not be found. Apr 20 16:12:26 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:12:26 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-cc8b864f-bb15-45b5-b820-10f12ebe25f4 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] Returning 404 to user: Volume c5a78759-a08d-49ec-b116-b9b6a0a586b5 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:12:26 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-cc8b864f-bb15-45b5-b820-10f12ebe25f4 tempest-VolumesGetTestJSON-177633402 tempest-VolumesGetTestJSON-177633402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5" status: 404 len: 109 microversion: 2.1 time: 0.036645 Apr 20 16:12:26 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 117/353] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 16:12:26 2023] GET /compute/v2.1/os-volumes/c5a78759-a08d-49ec-b116-b9b6a0a586b5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:39 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:12:39 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-8a869c48-a8bf-4543-a5d7-021b117f3214 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.243722 Apr 20 16:12:39 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 119/354] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:12:39 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:39 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:12:39 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-b7598546-4d21-44c3-9437-16629a0354c0 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.147881 Apr 20 16:12:39 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 119/355] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:12:39 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:39 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:12:39 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-3f384415-5ce8-4d0d-8017-248e0e4aa712 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.280515 Apr 20 16:12:39 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 118/356] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:12:39 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:12:59 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851a3140769443e4b62b73b987e2b417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc4f384caf14fb3baff01938400bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:12:59 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-ab0489ed-bce6-4e43-a76f-99a2745a2fb3 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2" status: 200 len: 1565 microversion: 2.1 time: 0.431927 Apr 20 16:12:59 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:12:59 2023] GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2 => generated 1565 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:01 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:13:01 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-535da986-0849-4a33-ac40-3691c303e59c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2" status: 204 len: 0 microversion: 2.1 time: 0.110436 Apr 20 16:13:01 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 120/358] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:13:01 2023] DELETE /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:01 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-675631a7-3d3d-4f2c-a7cb-8a940a5a1732 req-59266d7c-2b32-4c82-bcd1-355f645899d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6766bf80-e99c-4363-b229-84049f21b1a2", "name": "network-vif-unplugged", "status": "completed", "tag": "6ee15985-c252-4270-ad30-f6f5efe94b86"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:13:01 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-675631a7-3d3d-4f2c-a7cb-8a940a5a1732 req-59266d7c-2b32-4c82-bcd1-355f645899d4 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:01 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-675631a7-3d3d-4f2c-a7cb-8a940a5a1732 req-59266d7c-2b32-4c82-bcd1-355f645899d4 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:01 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-675631a7-3d3d-4f2c-a7cb-8a940a5a1732 req-59266d7c-2b32-4c82-bcd1-355f645899d4 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:01 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-675631a7-3d3d-4f2c-a7cb-8a940a5a1732 req-59266d7c-2b32-4c82-bcd1-355f645899d4 service nova] Creating event network-vif-unplugged:6ee15985-c252-4270-ad30-f6f5efe94b86 for instance 6766bf80-e99c-4363-b229-84049f21b1a2 on user Apr 20 16:13:01 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-675631a7-3d3d-4f2c-a7cb-8a940a5a1732 req-59266d7c-2b32-4c82-bcd1-355f645899d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035694 Apr 20 16:13:01 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 121/359] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:13:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:13:01 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851a3140769443e4b62b73b987e2b417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc4f384caf14fb3baff01938400bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:13:01 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-912222cd-4e6d-4243-84b3-c68a46c4667c tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2" status: 200 len: 1571 microversion: 2.1 time: 0.750904 Apr 20 16:13:01 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 119/360] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:13:01 2023] GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2 => generated 1571 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:13:03 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-b8593d38-777b-4b75-b358-f8b148cec860 req-35dcb8ed-ca63-4f1b-b9f9-f730b87a41e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6766bf80-e99c-4363-b229-84049f21b1a2", "name": "network-vif-plugged", "status": "completed", "tag": "6ee15985-c252-4270-ad30-f6f5efe94b86"}, {"server_uuid": "6766bf80-e99c-4363-b229-84049f21b1a2", "name": "network-vif-deleted", "tag": "6ee15985-c252-4270-ad30-f6f5efe94b86"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:13:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-b8593d38-777b-4b75-b358-f8b148cec860 req-35dcb8ed-ca63-4f1b-b9f9-f730b87a41e9 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-b8593d38-777b-4b75-b358-f8b148cec860 req-35dcb8ed-ca63-4f1b-b9f9-f730b87a41e9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-b8593d38-777b-4b75-b358-f8b148cec860 req-35dcb8ed-ca63-4f1b-b9f9-f730b87a41e9 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:03 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-b8593d38-777b-4b75-b358-f8b148cec860 req-35dcb8ed-ca63-4f1b-b9f9-f730b87a41e9 service nova] Creating event network-vif-plugged:6ee15985-c252-4270-ad30-f6f5efe94b86 for instance 6766bf80-e99c-4363-b229-84049f21b1a2 on user Apr 20 16:13:03 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-b8593d38-777b-4b75-b358-f8b148cec860 req-35dcb8ed-ca63-4f1b-b9f9-f730b87a41e9 service nova] Creating event network-vif-deleted:6ee15985-c252-4270-ad30-f6f5efe94b86 for instance 6766bf80-e99c-4363-b229-84049f21b1a2 on user Apr 20 16:13:03 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-b8593d38-777b-4b75-b358-f8b148cec860 req-35dcb8ed-ca63-4f1b-b9f9-f730b87a41e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032518 Apr 20 16:13:03 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 121/361] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:13:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=8 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:41 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:13:41 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-28ea5d71-a83d-40c6-bd47-b8862b95b199 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1656 microversion: 2.1 time: 0.216511 Apr 20 16:13:41 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 122/362] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:13:41 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1656 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] [instance: 6766bf80-e99c-4363-b229-84049f21b1a2] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:13:51 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] HTTP exception thrown: Instance 6766bf80-e99c-4363-b229-84049f21b1a2 could not be found. Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Request method failure captured: Apr 20 16:13:51 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2 HTTP/1.1 Apr 20 16:13:51 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:13:51 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:13:51 user devstack@n-api.service[61518]: Connection: close Apr 20 16:13:51 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:13:51 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:13:51 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:13:51 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:13:51 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWQTSvpaZkdKpmLOgDjhn3WxevuJQyILz7n2mMU7B6ed67bwTAI1iIJsmTURBH-J1yEo0jQQ30ikoTqPqNIEemD23HtIolCD24jR7JsjIHwf3lmDJv_f4IQqb2gDzlTpJDjOTlYZKhAADv5vY9R3JLI66ZKo8YKkOrfSRGsye-NmnM4 Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Project-Id: 3cc4f384caf14fb3baff01938400bb4b Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Project-Name: tempest-SnapshotDataIntegrityTests-901842767 Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3cc4f384caf14fb3baff01938400bb4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3cc4f384caf14fb3baff01938400bb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3cc4f384caf14fb3baff01938400bb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Tenant: tempest-SnapshotDataIntegrityTests-901842767 Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Tenant-Id: 3cc4f384caf14fb3baff01938400bb4b Apr 20 16:13:51 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-901842767 Apr 20 16:13:51 user devstack@n-api.service[61518]: X-User: tempest-SnapshotDataIntegrityTests-901842767-project-member Apr 20 16:13:51 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:13:51 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:13:51 user devstack@n-api.service[61518]: X-User-Id: 851a3140769443e4b62b73b987e2b417 Apr 20 16:13:51 user devstack@n-api.service[61518]: X-User-Name: tempest-SnapshotDataIntegrityTests-901842767-project-member Apr 20 16:13:51 user devstack@n-api.service[61518]: method: > Apr 20 16:13:51 user devstack@n-api.service[61518]: exception: Instance 6766bf80-e99c-4363-b229-84049f21b1a2 could not be found. Apr 20 16:13:51 user devstack@n-api.service[61518]: action_args: {'id': '6766bf80-e99c-4363-b229-84049f21b1a2'} Apr 20 16:13:51 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6766bf80-e99c-4363-b229-84049f21b1a2 could not be found. Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6766bf80-e99c-4363-b229-84049f21b1a2 could not be found. Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6766bf80-e99c-4363-b229-84049f21b1a2 could not be found. Apr 20 16:13:51 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:13:51 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Returning 404 to user: Instance 6766bf80-e99c-4363-b229-84049f21b1a2 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:13:51 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-e9462289-500c-4686-bdc8-e59bdd9939c0 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2" status: 404 len: 111 microversion: 2.1 time: 0.031184 Apr 20 16:13:51 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 120/363] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:13:51 2023] GET /compute/v2.1/servers/6766bf80-e99c-4363-b229-84049f21b1a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:13:52 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-57f2af6a-85e2-430a-a53c-52e243678957 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] Calling method '.version_select at 0x7f55879f3c70>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:13:52 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:52 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:13:52 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:13:52 user devstack@n-api.service[61517]: Thu Apr 20 16:13:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1504266769 (ip 10.0.0.210) !!! Apr 20 16:13:52 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-57f2af6a-85e2-430a-a53c-52e243678957 tempest-SnapshotDataIntegrityTests-901842767 tempest-SnapshotDataIntegrityTests-901842767-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1504266769" status: 202 len: 0 microversion: 2.1 time: 0.034297 Apr 20 16:13:52 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 122/364] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 20 16:13:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1504266769 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:14:42 user devstack@n-api.service[61519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:14:42 user devstack@n-api.service[61519]: Thu Apr 20 16:14:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 (ip 10.0.0.210) !!! Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:14:42 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:14:42 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-e3b68293-d83d-4b31-9546-37b2b0a13c44 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 204 len: 0 microversion: 2.1 time: 0.116066 Apr 20 16:14:42 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 123/365] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:14:42 2023] DELETE /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:14:42 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:14:42 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6dee2194d04f45a81fd0ef45ca0632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd2a72dddad4f2892243a33df4fa2d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:14:42 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-f86660ba-867c-4205-ab4b-43e884e7d43f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 200 len: 1662 microversion: 2.1 time: 0.255402 Apr 20 16:14:42 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 121/366] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:14:42 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 1662 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:14:42 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-6ff7fdda-7934-41e0-9529-fb84f712e8cc req-fdc2145a-c566-4fa6-a039-ddab666555cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d42ba7-cf47-4374-83b5-06d5242951b7", "name": "network-vif-unplugged", "status": "completed", "tag": "e068d7e5-dc70-4b18-8dd6-5726f7a3bc84"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:14:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-6ff7fdda-7934-41e0-9529-fb84f712e8cc req-fdc2145a-c566-4fa6-a039-ddab666555cc service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:14:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-6ff7fdda-7934-41e0-9529-fb84f712e8cc req-fdc2145a-c566-4fa6-a039-ddab666555cc service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:14:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-6ff7fdda-7934-41e0-9529-fb84f712e8cc req-fdc2145a-c566-4fa6-a039-ddab666555cc service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:14:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-6ff7fdda-7934-41e0-9529-fb84f712e8cc req-fdc2145a-c566-4fa6-a039-ddab666555cc service nova] Creating event network-vif-unplugged:e068d7e5-dc70-4b18-8dd6-5726f7a3bc84 for instance 15d42ba7-cf47-4374-83b5-06d5242951b7 on user Apr 20 16:14:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-6ff7fdda-7934-41e0-9529-fb84f712e8cc req-fdc2145a-c566-4fa6-a039-ddab666555cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.262266 Apr 20 16:14:42 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 123/367] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:14:44 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-546dda97-69c9-4f5d-9a48-cb6d91761b2a req-1c32ee3a-b2bd-4885-81af-cf2ee72daa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d42ba7-cf47-4374-83b5-06d5242951b7", "name": "network-vif-plugged", "status": "completed", "tag": "e068d7e5-dc70-4b18-8dd6-5726f7a3bc84"}, {"server_uuid": "15d42ba7-cf47-4374-83b5-06d5242951b7", "name": "network-vif-deleted", "tag": "e068d7e5-dc70-4b18-8dd6-5726f7a3bc84"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:14:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-546dda97-69c9-4f5d-9a48-cb6d91761b2a req-1c32ee3a-b2bd-4885-81af-cf2ee72daa19 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:14:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-546dda97-69c9-4f5d-9a48-cb6d91761b2a req-1c32ee3a-b2bd-4885-81af-cf2ee72daa19 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:14:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-546dda97-69c9-4f5d-9a48-cb6d91761b2a req-1c32ee3a-b2bd-4885-81af-cf2ee72daa19 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:14:44 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-546dda97-69c9-4f5d-9a48-cb6d91761b2a req-1c32ee3a-b2bd-4885-81af-cf2ee72daa19 service nova] Creating event network-vif-plugged:e068d7e5-dc70-4b18-8dd6-5726f7a3bc84 for instance 15d42ba7-cf47-4374-83b5-06d5242951b7 on user Apr 20 16:14:44 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-546dda97-69c9-4f5d-9a48-cb6d91761b2a req-1c32ee3a-b2bd-4885-81af-cf2ee72daa19 service nova] Creating event network-vif-deleted:e068d7e5-dc70-4b18-8dd6-5726f7a3bc84 for instance 15d42ba7-cf47-4374-83b5-06d5242951b7 on user Apr 20 16:14:44 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-546dda97-69c9-4f5d-9a48-cb6d91761b2a req-1c32ee3a-b2bd-4885-81af-cf2ee72daa19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030045 Apr 20 16:14:44 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 124/368] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] [instance: 15d42ba7-cf47-4374-83b5-06d5242951b7] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:15:32 user devstack@n-api.service[61518]: INFO nova.api.openstack.wsgi [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] HTTP exception thrown: Instance 15d42ba7-cf47-4374-83b5-06d5242951b7 could not be found. Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Request method failure captured: Apr 20 16:15:32 user devstack@n-api.service[61518]: request: GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 HTTP/1.1 Apr 20 16:15:32 user devstack@n-api.service[61518]: Accept: application/json Apr 20 16:15:32 user devstack@n-api.service[61518]: Accept-Encoding: identity Apr 20 16:15:32 user devstack@n-api.service[61518]: Connection: close Apr 20 16:15:32 user devstack@n-api.service[61518]: Content-Length: 0 Apr 20 16:15:32 user devstack@n-api.service[61518]: Content-Type: application/json Apr 20 16:15:32 user devstack@n-api.service[61518]: Host: 10.0.0.210 Apr 20 16:15:32 user devstack@n-api.service[61518]: Openstack-System-Scope: None Apr 20 16:15:32 user devstack@n-api.service[61518]: User-Agent: python-urllib3/1.26.15 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Auth-Token: gAAAAABkQWLcOQyz0YV-Sm6qrXraxLRAp4C8di47dhNEZUeVuw1bHZdtLNkoOGsp525nt3ShK8If9Q5L87irdmcixcbmjQA8qb4dWZKPVO2rT0Fck5NvKXYMbCVHzboXIDnIPoM62u9MorDwKDrw_ZnxalA4pD3WxHtE2K2nuOIkzpkqMCigaC0 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Domain-Id: None Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Domain-Name: None Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Identity-Status: Confirmed Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Is-Admin-Project: True Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Project-Domain-Id: default Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Project-Domain-Name: Default Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Project-Id: fbd2a72dddad4f2892243a33df4fa2d1 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Project-Name: tempest-ServerActionsTestJSON-893965653 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Role: reader,member Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Roles: reader,member Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbd2a72dddad4f2892243a33df4fa2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbd2a72dddad4f2892243a33df4fa2d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbd2a72dddad4f2892243a33df4fa2d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Tenant: tempest-ServerActionsTestJSON-893965653 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Tenant-Id: fbd2a72dddad4f2892243a33df4fa2d1 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-Tenant-Name: tempest-ServerActionsTestJSON-893965653 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-User: tempest-ServerActionsTestJSON-893965653-project-member Apr 20 16:15:32 user devstack@n-api.service[61518]: X-User-Domain-Id: default Apr 20 16:15:32 user devstack@n-api.service[61518]: X-User-Domain-Name: Default Apr 20 16:15:32 user devstack@n-api.service[61518]: X-User-Id: dd6dee2194d04f45a81fd0ef45ca0632 Apr 20 16:15:32 user devstack@n-api.service[61518]: X-User-Name: tempest-ServerActionsTestJSON-893965653-project-member Apr 20 16:15:32 user devstack@n-api.service[61518]: method: > Apr 20 16:15:32 user devstack@n-api.service[61518]: exception: Instance 15d42ba7-cf47-4374-83b5-06d5242951b7 could not be found. Apr 20 16:15:32 user devstack@n-api.service[61518]: action_args: {'id': '15d42ba7-cf47-4374-83b5-06d5242951b7'} Apr 20 16:15:32 user devstack@n-api.service[61518]: {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d42ba7-cf47-4374-83b5-06d5242951b7 could not be found. Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d42ba7-cf47-4374-83b5-06d5242951b7 could not be found. Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d42ba7-cf47-4374-83b5-06d5242951b7 could not be found. Apr 20 16:15:32 user devstack@n-api.service[61518]: ERROR nova.api.openstack.wsgi Apr 20 16:15:32 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Returning 404 to user: Instance 15d42ba7-cf47-4374-83b5-06d5242951b7 could not be found. {{(pid=61518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:15:32 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-beb859fc-446c-4e6a-aae3-723f4e56a90f tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7" status: 404 len: 111 microversion: 2.1 time: 0.035348 Apr 20 16:15:32 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 122/369] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:15:32 2023] GET /compute/v2.1/servers/15d42ba7-cf47-4374-83b5-06d5242951b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:15:32 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:32 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:32 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-9063768a-c933-434c-8ff3-6f8d0da26cd5 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] Calling method '.version_select at 0x7f558782f2e0>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:15:32 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-9063768a-c933-434c-8ff3-6f8d0da26cd5 tempest-ServerActionsTestJSON-893965653 tempest-ServerActionsTestJSON-893965653-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949594234" status: 202 len: 0 microversion: 2.1 time: 0.026503 Apr 20 16:15:32 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 124/370] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 16:15:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949594234 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:15:43 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:43 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:43 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1055967206", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "110d8e20-360f-48b7-8b42-9ae9760d39b8"}]}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:15:43 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] validate_networks() for [('110d8e20-360f-48b7-8b42-9ae9760d39b8', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for user 8c79a05e12ae4aab91bc79d32b02ef46 and project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:15:44 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:15:44 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-7334fc27-f319-43b1-988c-c7ba5593b806 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.790890 Apr 20 16:15:44 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 125/371] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 16:15:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 16:15:44 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-805b1f6d-3c1d-436d-86fd-22f2d942a8a6 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:15:44 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-805b1f6d-3c1d-436d-86fd-22f2d942a8a6 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:15:44 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:44 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:44 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-805b1f6d-3c1d-436d-86fd-22f2d942a8a6 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:15:44 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-805b1f6d-3c1d-436d-86fd-22f2d942a8a6 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:15:44 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-805b1f6d-3c1d-436d-86fd-22f2d942a8a6 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:15:44 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-805b1f6d-3c1d-436d-86fd-22f2d942a8a6 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778" status: 200 len: 1395 microversion: 2.87 time: 0.109230 Apr 20 16:15:44 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 123/372] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:15:44 2023] GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778 => generated 1395 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:15:47 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:15:47 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-11ade07e-2e9a-41b3-b5fe-f96f23e22c43 req-6f3402ea-0c02-4f28-acf6-dce3d56b75fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabd55bf-46c4-41be-942d-b6563f6b2778", "tag": "51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:15:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-11ade07e-2e9a-41b3-b5fe-f96f23e22c43 req-6f3402ea-0c02-4f28-acf6-dce3d56b75fb service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:15:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-11ade07e-2e9a-41b3-b5fe-f96f23e22c43 req-6f3402ea-0c02-4f28-acf6-dce3d56b75fb service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:15:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-11ade07e-2e9a-41b3-b5fe-f96f23e22c43 req-6f3402ea-0c02-4f28-acf6-dce3d56b75fb service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:15:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-11ade07e-2e9a-41b3-b5fe-f96f23e22c43 req-6f3402ea-0c02-4f28-acf6-dce3d56b75fb service nova] Creating event network-changed:51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff for instance cabd55bf-46c4-41be-942d-b6563f6b2778 on user Apr 20 16:15:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-11ade07e-2e9a-41b3-b5fe-f96f23e22c43 req-6f3402ea-0c02-4f28-acf6-dce3d56b75fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030607 Apr 20 16:15:47 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:15:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:15:49 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-604aeda5-81d2-47bb-8ea2-06df8ffe9036 req-e59a8903-b6af-4e42-8fe3-e54987b50c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabd55bf-46c4-41be-942d-b6563f6b2778", "name": "network-vif-plugged", "status": "completed", "tag": "51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:15:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-604aeda5-81d2-47bb-8ea2-06df8ffe9036 req-e59a8903-b6af-4e42-8fe3-e54987b50c3f service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:15:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-604aeda5-81d2-47bb-8ea2-06df8ffe9036 req-e59a8903-b6af-4e42-8fe3-e54987b50c3f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:15:49 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-604aeda5-81d2-47bb-8ea2-06df8ffe9036 req-e59a8903-b6af-4e42-8fe3-e54987b50c3f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:15:49 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-604aeda5-81d2-47bb-8ea2-06df8ffe9036 req-e59a8903-b6af-4e42-8fe3-e54987b50c3f service nova] Creating event network-vif-plugged:51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff for instance cabd55bf-46c4-41be-942d-b6563f6b2778 on user Apr 20 16:15:49 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-604aeda5-81d2-47bb-8ea2-06df8ffe9036 req-e59a8903-b6af-4e42-8fe3-e54987b50c3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123011 Apr 20 16:15:49 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:15:51 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-8d171b31-7fd2-4e3e-90d1-3f45bcdf70f2 req-1f2d629f-acc3-4a75-9638-7b8e29d9fcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabd55bf-46c4-41be-942d-b6563f6b2778", "name": "network-vif-plugged", "status": "completed", "tag": "51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:15:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8d171b31-7fd2-4e3e-90d1-3f45bcdf70f2 req-1f2d629f-acc3-4a75-9638-7b8e29d9fcb1 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:15:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8d171b31-7fd2-4e3e-90d1-3f45bcdf70f2 req-1f2d629f-acc3-4a75-9638-7b8e29d9fcb1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:15:51 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-8d171b31-7fd2-4e3e-90d1-3f45bcdf70f2 req-1f2d629f-acc3-4a75-9638-7b8e29d9fcb1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:15:51 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-8d171b31-7fd2-4e3e-90d1-3f45bcdf70f2 req-1f2d629f-acc3-4a75-9638-7b8e29d9fcb1 service nova] Creating event network-vif-plugged:51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff for instance cabd55bf-46c4-41be-942d-b6563f6b2778 on user Apr 20 16:15:51 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-8d171b31-7fd2-4e3e-90d1-3f45bcdf70f2 req-1f2d629f-acc3-4a75-9638-7b8e29d9fcb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032296 Apr 20 16:15:51 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 124/375] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:15:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:16:34 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:16:34 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-911b8d9d-e10a-4f8e-bb4f-aa110bd531db tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778" status: 200 len: 1691 microversion: 2.87 time: 0.352140 Apr 20 16:16:34 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 126/376] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:16:34 2023] GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778 => generated 1691 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-158318899"}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:17:35 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:17:35 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-a6e87014-9235-4337-abc6-fe7e6a5fc1ee tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778/action" status: 202 len: 52 microversion: 2.87 time: 0.819715 Apr 20 16:17:35 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 127/377] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 16:17:34 2023] POST /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778/action => generated 52 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=8 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:17:41 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:17:41 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-154856f0-3b4a-4d15-9d3e-f6d3de4963d5 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778" status: 200 len: 1691 microversion: 2.87 time: 0.295868 Apr 20 16:17:41 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 125/378] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:17:41 2023] GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:18:41 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1807434348", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "110d8e20-360f-48b7-8b42-9ae9760d39b8"}]}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:18:41 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:18:41 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:18:41 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:18:41 user devstack@n-api.service[61517]: Thu Apr 20 16:18:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:18:41 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:18:41 user devstack@n-api.service[61517]: Thu Apr 20 16:18:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:18:41 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] validate_networks() for [('110d8e20-360f-48b7-8b42-9ae9760d39b8', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for user 8c79a05e12ae4aab91bc79d32b02ef46 and project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:18:42 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:18:42 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-95c6a2ca-22a3-4b01-bcd4-c0fb55468d22 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.677697 Apr 20 16:18:42 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 127/379] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 16:18:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 16:18:42 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:18:42 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:18:42 user devstack@n-api.service[61519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:18:42 user devstack@n-api.service[61519]: Thu Apr 20 16:18:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff (ip 10.0.0.210) !!! Apr 20 16:18:42 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-57141cd4-4fb2-415b-a67a-9262744ab460 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:18:42 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-57141cd4-4fb2-415b-a67a-9262744ab460 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:18:42 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-57141cd4-4fb2-415b-a67a-9262744ab460 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:18:42 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-57141cd4-4fb2-415b-a67a-9262744ab460 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:18:42 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-57141cd4-4fb2-415b-a67a-9262744ab460 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:18:42 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-57141cd4-4fb2-415b-a67a-9262744ab460 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff" status: 200 len: 1395 microversion: 2.87 time: 0.165251 Apr 20 16:18:42 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 128/380] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:18:42 2023] GET /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff => generated 1395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:18:45 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:18:45 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:18:45 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:18:45 user devstack@n-api.service[61518]: Thu Apr 20 16:18:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 16:18:45 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-abd42c01-687a-47dc-b35b-fff4a3758b95 req-4ba4f6be-ef26-469d-82dd-c60c8ae60a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f02f05-1afe-4818-a4a9-14a4d6384eff", "tag": "2917d2ac-f6bb-462b-a7b4-3ed39a7fad08"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:18:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-abd42c01-687a-47dc-b35b-fff4a3758b95 req-4ba4f6be-ef26-469d-82dd-c60c8ae60a72 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:18:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-abd42c01-687a-47dc-b35b-fff4a3758b95 req-4ba4f6be-ef26-469d-82dd-c60c8ae60a72 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:18:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-abd42c01-687a-47dc-b35b-fff4a3758b95 req-4ba4f6be-ef26-469d-82dd-c60c8ae60a72 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:18:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-abd42c01-687a-47dc-b35b-fff4a3758b95 req-4ba4f6be-ef26-469d-82dd-c60c8ae60a72 service nova] Creating event network-changed:2917d2ac-f6bb-462b-a7b4-3ed39a7fad08 for instance 21f02f05-1afe-4818-a4a9-14a4d6384eff on user Apr 20 16:18:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-abd42c01-687a-47dc-b35b-fff4a3758b95 req-4ba4f6be-ef26-469d-82dd-c60c8ae60a72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038098 Apr 20 16:18:45 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:18:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:18:47 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-d870b2c7-4334-4474-8d68-56e0765c0024 req-8fc2191f-7694-4400-ab06-1b1c46457adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f02f05-1afe-4818-a4a9-14a4d6384eff", "name": "network-vif-deleted", "tag": "2917d2ac-f6bb-462b-a7b4-3ed39a7fad08"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:18:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-d870b2c7-4334-4474-8d68-56e0765c0024 req-8fc2191f-7694-4400-ab06-1b1c46457adf service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:18:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-d870b2c7-4334-4474-8d68-56e0765c0024 req-8fc2191f-7694-4400-ab06-1b1c46457adf service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:18:47 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-d870b2c7-4334-4474-8d68-56e0765c0024 req-8fc2191f-7694-4400-ab06-1b1c46457adf service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:18:47 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.compute.server_external_events [req-d870b2c7-4334-4474-8d68-56e0765c0024 req-8fc2191f-7694-4400-ab06-1b1c46457adf service nova] Unable to find a host for instance 21f02f05-1afe-4818-a4a9-14a4d6384eff. Dropping event network-vif-deleted {{(pid=61517) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 16:18:47 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-d870b2c7-4334-4474-8d68-56e0765c0024 req-8fc2191f-7694-4400-ab06-1b1c46457adf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.033056 Apr 20 16:18:47 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 128/382] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:18:47 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG nova.objects.instance [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lazy-loading 'fault' on Instance uuid 21f02f05-1afe-4818-a4a9-14a4d6384eff {{(pid=61519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:19:32 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:19:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-940f36c7-8b57-4c01-bdb8-a4e20fd04b8b tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff" status: 200 len: 1650 microversion: 2.87 time: 0.159068 Apr 20 16:19:32 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 129/383] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:19:32 2023] GET /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff => generated 1650 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Doing local delete in cell c920c466-c336-4d65-b6e3-87fa61d5f331(cell1) {{(pid=61518) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:32 user devstack@n-api.service[61518]: WARNING nova.compute.api [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] instance's host None is down, deleting from database Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] deallocate_for_instance() {{(pid=61518) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Instance cache missing network info. {{(pid=61518) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Updating instance_info_cache with network_info: [] {{(pid=61518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 16:19:32 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61518) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 16:19:32 user devstack@n-api.service[61518]: WARNING nova.compute.api [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 16:19:33 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-75805b73-0543-48e4-bf71-d9a99b625baf tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff" status: 204 len: 0 microversion: 2.87 time: 0.697713 Apr 20 16:19:33 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 127/384] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:19:32 2023] DELETE /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff => generated 0 bytes in 700 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 21f02f05-1afe-4818-a4a9-14a4d6384eff] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] HTTP exception thrown: Instance 21f02f05-1afe-4818-a4a9-14a4d6384eff could not be found. Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Request method failure captured: Apr 20 16:19:33 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff HTTP/1.1 Apr 20 16:19:33 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:19:33 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:19:33 user devstack@n-api.service[61517]: Connection: close Apr 20 16:19:33 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:19:33 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:19:33 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:19:33 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:19:33 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWUvygav6XiGnd6jDhv3045ShMaaz0eFdLFWwQ-c7QolmQMrxH2kcMWHZeDgmEzhN08puzv-0GFUsUD9mab0wvEJmobVS6E9O153pFsl1fufzBmM11SkPKTrIfg59bUuiqJAzAi6fQRBvxGgkbCbMoE5kYkl4PN3RDfxKM7ofi6bll4 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Project-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Tenant-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:19:33 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:19:33 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:19:33 user devstack@n-api.service[61517]: X-User-Id: 8c79a05e12ae4aab91bc79d32b02ef46 Apr 20 16:19:33 user devstack@n-api.service[61517]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:19:33 user devstack@n-api.service[61517]: method: > Apr 20 16:19:33 user devstack@n-api.service[61517]: exception: Instance 21f02f05-1afe-4818-a4a9-14a4d6384eff could not be found. Apr 20 16:19:33 user devstack@n-api.service[61517]: action_args: {'id': '21f02f05-1afe-4818-a4a9-14a4d6384eff'} Apr 20 16:19:33 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f02f05-1afe-4818-a4a9-14a4d6384eff could not be found. Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f02f05-1afe-4818-a4a9-14a4d6384eff could not be found. Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f02f05-1afe-4818-a4a9-14a4d6384eff could not be found. Apr 20 16:19:33 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:19:33 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Returning 404 to user: Instance 21f02f05-1afe-4818-a4a9-14a4d6384eff could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:19:33 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-bbb802a9-3093-40b5-82d4-d243b74fd83d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff" status: 404 len: 111 microversion: 2.87 time: 0.037661 Apr 20 16:19:33 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 129/385] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:19:33 2023] GET /compute/v2.1/servers/21f02f05-1afe-4818-a4a9-14a4d6384eff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1879699440", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "networks": [{"uuid": "110d8e20-360f-48b7-8b42-9ae9760d39b8"}]}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] validate_networks() for [('110d8e20-360f-48b7-8b42-9ae9760d39b8', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for user 8c79a05e12ae4aab91bc79d32b02ef46 and project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:19:33 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:19:33 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-cd3b40b9-a1ae-406e-b8de-c528b415cdd3 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.622486 Apr 20 16:19:33 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 130/386] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 16:19:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 16:19:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-98a0093c-7fa5-409e-92a4-a135a54b4d0c tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:19:33 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-98a0093c-7fa5-409e-92a4-a135a54b4d0c tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:19:34 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-98a0093c-7fa5-409e-92a4-a135a54b4d0c tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:19:34 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-98a0093c-7fa5-409e-92a4-a135a54b4d0c tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:19:34 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-98a0093c-7fa5-409e-92a4-a135a54b4d0c tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:19:34 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-98a0093c-7fa5-409e-92a4-a135a54b4d0c tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564" status: 200 len: 1395 microversion: 2.87 time: 0.083055 Apr 20 16:19:34 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 128/387] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:19:33 2023] GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 => generated 1395 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:19:36 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-9581f701-1465-41fb-96b8-5e21618e4864 req-82664cce-96af-44bb-b829-5c73cf48013c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972fbea6-71af-4e33-9f9d-d82c46fcd564", "tag": "5e633cb4-e056-4752-9478-8e180c9c6869"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:19:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9581f701-1465-41fb-96b8-5e21618e4864 req-82664cce-96af-44bb-b829-5c73cf48013c service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9581f701-1465-41fb-96b8-5e21618e4864 req-82664cce-96af-44bb-b829-5c73cf48013c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9581f701-1465-41fb-96b8-5e21618e4864 req-82664cce-96af-44bb-b829-5c73cf48013c service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-9581f701-1465-41fb-96b8-5e21618e4864 req-82664cce-96af-44bb-b829-5c73cf48013c service nova] Creating event network-changed:5e633cb4-e056-4752-9478-8e180c9c6869 for instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 on user Apr 20 16:19:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-9581f701-1465-41fb-96b8-5e21618e4864 req-82664cce-96af-44bb-b829-5c73cf48013c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033173 Apr 20 16:19:36 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 130/388] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:19:38 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-50bde0b3-d16b-40e2-a0c2-bf941664d992 req-d8b97ed7-2f15-429f-91c7-b658456ede8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972fbea6-71af-4e33-9f9d-d82c46fcd564", "name": "network-vif-plugged", "status": "completed", "tag": "5e633cb4-e056-4752-9478-8e180c9c6869"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:19:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-50bde0b3-d16b-40e2-a0c2-bf941664d992 req-d8b97ed7-2f15-429f-91c7-b658456ede8b service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-50bde0b3-d16b-40e2-a0c2-bf941664d992 req-d8b97ed7-2f15-429f-91c7-b658456ede8b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-50bde0b3-d16b-40e2-a0c2-bf941664d992 req-d8b97ed7-2f15-429f-91c7-b658456ede8b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:38 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-50bde0b3-d16b-40e2-a0c2-bf941664d992 req-d8b97ed7-2f15-429f-91c7-b658456ede8b service nova] Creating event network-vif-plugged:5e633cb4-e056-4752-9478-8e180c9c6869 for instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 on user Apr 20 16:19:38 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-50bde0b3-d16b-40e2-a0c2-bf941664d992 req-d8b97ed7-2f15-429f-91c7-b658456ede8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029632 Apr 20 16:19:38 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 131/389] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:19:41 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-6a68abe9-d6ed-4e16-8854-9eb608cc7d3c req-7e484e40-993b-43dd-95e5-2004dbce9e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972fbea6-71af-4e33-9f9d-d82c46fcd564", "name": "network-vif-plugged", "status": "completed", "tag": "5e633cb4-e056-4752-9478-8e180c9c6869"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:19:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-6a68abe9-d6ed-4e16-8854-9eb608cc7d3c req-7e484e40-993b-43dd-95e5-2004dbce9e6a service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:19:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-6a68abe9-d6ed-4e16-8854-9eb608cc7d3c req-7e484e40-993b-43dd-95e5-2004dbce9e6a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:19:41 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-6a68abe9-d6ed-4e16-8854-9eb608cc7d3c req-7e484e40-993b-43dd-95e5-2004dbce9e6a service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:19:41 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-6a68abe9-d6ed-4e16-8854-9eb608cc7d3c req-7e484e40-993b-43dd-95e5-2004dbce9e6a service nova] Creating event network-vif-plugged:5e633cb4-e056-4752-9478-8e180c9c6869 for instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 on user Apr 20 16:19:41 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-6a68abe9-d6ed-4e16-8854-9eb608cc7d3c req-7e484e40-993b-43dd-95e5-2004dbce9e6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034342 Apr 20 16:19:41 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 129/390] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:20:24 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:20:24 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-0981c96a-284d-499b-ae59-bbbc32fc7867 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564" status: 200 len: 1692 microversion: 2.87 time: 0.237491 Apr 20 16:20:24 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 131/391] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:20:24 2023] GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:21:24 user devstack@n-api.service[61519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:21:24 user devstack@n-api.service[61519]: Thu Apr 20 16:21:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564/action (ip 10.0.0.210) !!! Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=12 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-395122235"}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:21:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:21:25 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-90016ebd-397c-4a07-bbef-204473bdf394 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "POST /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564/action" status: 202 len: 52 microversion: 2.87 time: 0.877815 Apr 20 16:21:25 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 132/392] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 16:21:24 2023] POST /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564/action => generated 52 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:21:30 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:21:30 user devstack@n-api.service[61518]: Thu Apr 20 16:21:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 (ip 10.0.0.210) !!! Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:21:30 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:21:30 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-35f98995-cba8-48f9-99f7-936639438af9 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564" status: 200 len: 1692 microversion: 2.87 time: 0.305308 Apr 20 16:21:30 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 130/393] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:21:30 2023] GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 => generated 1692 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:22:30 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:22:30 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:22:30 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:22:30 user devstack@n-api.service[61517]: Thu Apr 20 16:22:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:22:30 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:22:30 user devstack@n-api.service[61517]: Thu Apr 20 16:22:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:22:30 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:22:30 user devstack@n-api.service[61517]: Thu Apr 20 16:22:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:22:30 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-301528259", "imageRef": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "4ac69ea5-e5d7-40c8-864e-0a164d78a727", "destination_type": "volume"}], "networks": [{"uuid": "110d8e20-360f-48b7-8b42-9ae9760d39b8"}]}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] validate_networks() for [('110d8e20-360f-48b7-8b42-9ae9760d39b8', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Getting quotas for user 8c79a05e12ae4aab91bc79d32b02ef46 and project 8f978ad5201e412894f30daa8e2bd2e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:22:31 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ac69ea5-e5d7-40c8-864e-0a164d78a727',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:22:31 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-6ef37d6c-8975-4862-a108-ee81ddfce279 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.694231 Apr 20 16:22:31 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 132/394] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 16:22:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 16:22:31 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:22:31 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:22:31 user devstack@n-api.service[61519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:22:31 user devstack@n-api.service[61519]: Thu Apr 20 16:22:31 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a (ip 10.0.0.210) !!! Apr 20 16:22:31 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-3be02dad-c230-4ea6-a9ec-f611cae8bba4 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:22:31 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-3be02dad-c230-4ea6-a9ec-f611cae8bba4 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:22:31 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-3be02dad-c230-4ea6-a9ec-f611cae8bba4 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:22:31 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-3be02dad-c230-4ea6-a9ec-f611cae8bba4 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:22:31 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-3be02dad-c230-4ea6-a9ec-f611cae8bba4 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:22:31 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-3be02dad-c230-4ea6-a9ec-f611cae8bba4 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a" status: 200 len: 1394 microversion: 2.87 time: 0.097043 Apr 20 16:22:31 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 133/395] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:22:31 2023] GET /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a => generated 1394 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:22:34 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:22:34 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:22:34 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:22:34 user devstack@n-api.service[61518]: Thu Apr 20 16:22:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 16:22:34 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:22:34 user devstack@n-api.service[61518]: Thu Apr 20 16:22:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 16:22:34 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-5b20e150-c5a7-4ae0-bf1c-e1ddad398313 req-c3f88d4e-8117-4fa5-8f16-96ead2549faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d7db8a-bebc-4924-8151-722ff9eb177a", "tag": "2ff3bfa7-7af2-4b5c-bce9-8fafca0ef930"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:22:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-5b20e150-c5a7-4ae0-bf1c-e1ddad398313 req-c3f88d4e-8117-4fa5-8f16-96ead2549faf service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:22:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-5b20e150-c5a7-4ae0-bf1c-e1ddad398313 req-c3f88d4e-8117-4fa5-8f16-96ead2549faf service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:22:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-5b20e150-c5a7-4ae0-bf1c-e1ddad398313 req-c3f88d4e-8117-4fa5-8f16-96ead2549faf service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:22:34 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-5b20e150-c5a7-4ae0-bf1c-e1ddad398313 req-c3f88d4e-8117-4fa5-8f16-96ead2549faf service nova] Creating event network-changed:2ff3bfa7-7af2-4b5c-bce9-8fafca0ef930 for instance b8d7db8a-bebc-4924-8151-722ff9eb177a on user Apr 20 16:22:34 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-5b20e150-c5a7-4ae0-bf1c-e1ddad398313 req-c3f88d4e-8117-4fa5-8f16-96ead2549faf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098114 Apr 20 16:22:34 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 131/396] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:22:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:22:36 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-9e453da5-be44-4b3a-a370-2c8bc131349c req-f529eb62-0273-4dd0-8d37-09f454b25f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d7db8a-bebc-4924-8151-722ff9eb177a", "name": "network-vif-deleted", "tag": "2ff3bfa7-7af2-4b5c-bce9-8fafca0ef930"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:22:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9e453da5-be44-4b3a-a370-2c8bc131349c req-f529eb62-0273-4dd0-8d37-09f454b25f36 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:22:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9e453da5-be44-4b3a-a370-2c8bc131349c req-f529eb62-0273-4dd0-8d37-09f454b25f36 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:22:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-9e453da5-be44-4b3a-a370-2c8bc131349c req-f529eb62-0273-4dd0-8d37-09f454b25f36 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:22:36 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.compute.server_external_events [req-9e453da5-be44-4b3a-a370-2c8bc131349c req-f529eb62-0273-4dd0-8d37-09f454b25f36 service nova] Unable to find a host for instance b8d7db8a-bebc-4924-8151-722ff9eb177a. Dropping event network-vif-deleted {{(pid=61517) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 16:22:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-9e453da5-be44-4b3a-a370-2c8bc131349c req-f529eb62-0273-4dd0-8d37-09f454b25f36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024427 Apr 20 16:22:36 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 133/397] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG nova.objects.instance [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lazy-loading 'fault' on Instance uuid b8d7db8a-bebc-4924-8151-722ff9eb177a {{(pid=61519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:23:21 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:23:21 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-f17fd383-02dc-48b5-b120-99b840645486 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a" status: 200 len: 1649 microversion: 2.87 time: 0.112090 Apr 20 16:23:21 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 134/398] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:23:21 2023] GET /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a => generated 1649 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:21 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Doing local delete in cell c920c466-c336-4d65-b6e3-87fa61d5f331(cell1) {{(pid=61518) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61518]: WARNING nova.compute.api [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] instance's host None is down, deleting from database Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] deallocate_for_instance() {{(pid=61518) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Instance cache missing network info. {{(pid=61518) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.network.neutron [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Updating instance_info_cache with network_info: [] {{(pid=61518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61518) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 16:23:22 user devstack@n-api.service[61518]: WARNING nova.compute.api [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 16:23:22 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-40697755-3936-45f6-b593-2537c2f6490f tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a" status: 204 len: 0 microversion: 2.87 time: 0.340227 Apr 20 16:23:22 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 132/399] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:23:21 2023] DELETE /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: b8d7db8a-bebc-4924-8151-722ff9eb177a] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] HTTP exception thrown: Instance b8d7db8a-bebc-4924-8151-722ff9eb177a could not be found. Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Request method failure captured: Apr 20 16:23:22 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a HTTP/1.1 Apr 20 16:23:22 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:23:22 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:23:22 user devstack@n-api.service[61517]: Connection: close Apr 20 16:23:22 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:23:22 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:23:22 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:23:22 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:23:22 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWUvygav6XiGnd6jDhv3045ShMaaz0eFdLFWwQ-c7QolmQMrxH2kcMWHZeDgmEzhN08puzv-0GFUsUD9mab0wvEJmobVS6E9O153pFsl1fufzBmM11SkPKTrIfg59bUuiqJAzAi6fQRBvxGgkbCbMoE5kYkl4PN3RDfxKM7ofi6bll4 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Project-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Tenant-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:23:22 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:23:22 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:23:22 user devstack@n-api.service[61517]: X-User-Id: 8c79a05e12ae4aab91bc79d32b02ef46 Apr 20 16:23:22 user devstack@n-api.service[61517]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:23:22 user devstack@n-api.service[61517]: method: > Apr 20 16:23:22 user devstack@n-api.service[61517]: exception: Instance b8d7db8a-bebc-4924-8151-722ff9eb177a could not be found. Apr 20 16:23:22 user devstack@n-api.service[61517]: action_args: {'id': 'b8d7db8a-bebc-4924-8151-722ff9eb177a'} Apr 20 16:23:22 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d7db8a-bebc-4924-8151-722ff9eb177a could not be found. Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d7db8a-bebc-4924-8151-722ff9eb177a could not be found. Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d7db8a-bebc-4924-8151-722ff9eb177a could not be found. Apr 20 16:23:22 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Returning 404 to user: Instance b8d7db8a-bebc-4924-8151-722ff9eb177a could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:23:22 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-3e2ec739-ef42-46d5-a5dd-1b9224fdb098 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a" status: 404 len: 111 microversion: 2.87 time: 0.038792 Apr 20 16:23:22 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 134/400] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:23:22 2023] GET /compute/v2.1/servers/b8d7db8a-bebc-4924-8151-722ff9eb177a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:23:22 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-06da7dda-4424-4842-84d7-1fef3835b790 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564" status: 204 len: 0 microversion: 2.87 time: 0.110553 Apr 20 16:23:22 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 135/401] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:23:22 2023] DELETE /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-1ae5ead7-112a-4a24-bcc3-e7de5df532cc req-8aff5709-3599-49c1-b6ad-bdf7e1322b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972fbea6-71af-4e33-9f9d-d82c46fcd564", "name": "network-vif-unplugged", "status": "completed", "tag": "5e633cb4-e056-4752-9478-8e180c9c6869"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1ae5ead7-112a-4a24-bcc3-e7de5df532cc req-8aff5709-3599-49c1-b6ad-bdf7e1322b00 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1ae5ead7-112a-4a24-bcc3-e7de5df532cc req-8aff5709-3599-49c1-b6ad-bdf7e1322b00 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-1ae5ead7-112a-4a24-bcc3-e7de5df532cc req-8aff5709-3599-49c1-b6ad-bdf7e1322b00 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:22 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-1ae5ead7-112a-4a24-bcc3-e7de5df532cc req-8aff5709-3599-49c1-b6ad-bdf7e1322b00 service nova] Creating event network-vif-unplugged:5e633cb4-e056-4752-9478-8e180c9c6869 for instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 on user Apr 20 16:23:22 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-1ae5ead7-112a-4a24-bcc3-e7de5df532cc req-8aff5709-3599-49c1-b6ad-bdf7e1322b00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031573 Apr 20 16:23:22 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 135/402] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:23:22 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:23:22 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-82bc7a66-ed02-429e-a85b-5f02c638658d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564" status: 200 len: 1698 microversion: 2.87 time: 0.277212 Apr 20 16:23:22 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 133/403] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:23:22 2023] GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 => generated 1698 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:23:24 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-0edeaf07-d640-488b-9981-811fcfdfd4c3 req-1fa9c4f8-5032-4e7b-aaea-38617a755a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972fbea6-71af-4e33-9f9d-d82c46fcd564", "name": "network-vif-plugged", "status": "completed", "tag": "5e633cb4-e056-4752-9478-8e180c9c6869"}, {"server_uuid": "972fbea6-71af-4e33-9f9d-d82c46fcd564", "name": "network-vif-deleted", "tag": "5e633cb4-e056-4752-9478-8e180c9c6869"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:23:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-0edeaf07-d640-488b-9981-811fcfdfd4c3 req-1fa9c4f8-5032-4e7b-aaea-38617a755a81 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:23:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-0edeaf07-d640-488b-9981-811fcfdfd4c3 req-1fa9c4f8-5032-4e7b-aaea-38617a755a81 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:23:24 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-0edeaf07-d640-488b-9981-811fcfdfd4c3 req-1fa9c4f8-5032-4e7b-aaea-38617a755a81 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:23:24 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-0edeaf07-d640-488b-9981-811fcfdfd4c3 req-1fa9c4f8-5032-4e7b-aaea-38617a755a81 service nova] Creating event network-vif-plugged:5e633cb4-e056-4752-9478-8e180c9c6869 for instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 on user Apr 20 16:23:24 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-0edeaf07-d640-488b-9981-811fcfdfd4c3 req-1fa9c4f8-5032-4e7b-aaea-38617a755a81 service nova] Creating event network-vif-deleted:5e633cb4-e056-4752-9478-8e180c9c6869 for instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 on user Apr 20 16:23:24 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-0edeaf07-d640-488b-9981-811fcfdfd4c3 req-1fa9c4f8-5032-4e7b-aaea-38617a755a81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030074 Apr 20 16:23:24 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 136/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:23:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: 972fbea6-71af-4e33-9f9d-d82c46fcd564] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:12 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] HTTP exception thrown: Instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 could not be found. Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Request method failure captured: Apr 20 16:24:12 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 HTTP/1.1 Apr 20 16:24:12 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:24:12 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:24:12 user devstack@n-api.service[61517]: Connection: close Apr 20 16:24:12 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:24:12 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:24:12 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:24:12 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:24:12 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWUvygav6XiGnd6jDhv3045ShMaaz0eFdLFWwQ-c7QolmQMrxH2kcMWHZeDgmEzhN08puzv-0GFUsUD9mab0wvEJmobVS6E9O153pFsl1fufzBmM11SkPKTrIfg59bUuiqJAzAi6fQRBvxGgkbCbMoE5kYkl4PN3RDfxKM7ofi6bll4 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Project-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Tenant-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:24:12 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:24:12 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:24:12 user devstack@n-api.service[61517]: X-User-Id: 8c79a05e12ae4aab91bc79d32b02ef46 Apr 20 16:24:12 user devstack@n-api.service[61517]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:24:12 user devstack@n-api.service[61517]: method: > Apr 20 16:24:12 user devstack@n-api.service[61517]: exception: Instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 could not be found. Apr 20 16:24:12 user devstack@n-api.service[61517]: action_args: {'id': '972fbea6-71af-4e33-9f9d-d82c46fcd564'} Apr 20 16:24:12 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 could not be found. Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 could not be found. Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 could not be found. Apr 20 16:24:12 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:24:12 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Returning 404 to user: Instance 972fbea6-71af-4e33-9f9d-d82c46fcd564 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:24:12 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-7ac5742a-4361-41f6-94b4-4104ea80d3e7 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564" status: 404 len: 111 microversion: 2.87 time: 0.035069 Apr 20 16:24:12 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 136/405] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:24:12 2023] GET /compute/v2.1/servers/972fbea6-71af-4e33-9f9d-d82c46fcd564 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:13 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Going to try to terminate instance {{(pid=61518) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:24:13 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-44fd8f1c-8595-4b83-b310-a38174712c58 tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778" status: 204 len: 0 microversion: 2.87 time: 0.138905 Apr 20 16:24:13 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 134/406] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 16:24:13 2023] DELETE /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:24:13 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c79a05e12ae4aab91bc79d32b02ef46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f978ad5201e412894f30daa8e2bd2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:24:13 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-b90153b7-a3fe-495c-9715-dbe7c96b38aa tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778" status: 200 len: 1697 microversion: 2.87 time: 0.370618 Apr 20 16:24:13 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 137/407] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:24:13 2023] GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778 => generated 1697 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 16:24:13 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-ce5ec0db-6422-4fe5-aec9-b450c5558266 req-6426e617-aa35-4850-8db8-1de8fc99b2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabd55bf-46c4-41be-942d-b6563f6b2778", "name": "network-vif-unplugged", "status": "completed", "tag": "51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:24:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ce5ec0db-6422-4fe5-aec9-b450c5558266 req-6426e617-aa35-4850-8db8-1de8fc99b2b3 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ce5ec0db-6422-4fe5-aec9-b450c5558266 req-6426e617-aa35-4850-8db8-1de8fc99b2b3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:13 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ce5ec0db-6422-4fe5-aec9-b450c5558266 req-6426e617-aa35-4850-8db8-1de8fc99b2b3 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:13 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-ce5ec0db-6422-4fe5-aec9-b450c5558266 req-6426e617-aa35-4850-8db8-1de8fc99b2b3 service nova] Creating event network-vif-unplugged:51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff for instance cabd55bf-46c4-41be-942d-b6563f6b2778 on user Apr 20 16:24:13 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-ce5ec0db-6422-4fe5-aec9-b450c5558266 req-6426e617-aa35-4850-8db8-1de8fc99b2b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164075 Apr 20 16:24:13 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:24:14 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-94692dde-f7d6-4f8f-8654-a9a1f6ef00f9 req-b7349462-fa73-4480-944b-4da4bc696f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabd55bf-46c4-41be-942d-b6563f6b2778", "name": "network-vif-deleted", "tag": "51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:24:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-94692dde-f7d6-4f8f-8654-a9a1f6ef00f9 req-b7349462-fa73-4480-944b-4da4bc696f3b service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-94692dde-f7d6-4f8f-8654-a9a1f6ef00f9 req-b7349462-fa73-4480-944b-4da4bc696f3b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:14 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-94692dde-f7d6-4f8f-8654-a9a1f6ef00f9 req-b7349462-fa73-4480-944b-4da4bc696f3b service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:14 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-94692dde-f7d6-4f8f-8654-a9a1f6ef00f9 req-b7349462-fa73-4480-944b-4da4bc696f3b service nova] Creating event network-vif-deleted:51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff for instance cabd55bf-46c4-41be-942d-b6563f6b2778 on user Apr 20 16:24:14 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-94692dde-f7d6-4f8f-8654-a9a1f6ef00f9 req-b7349462-fa73-4480-944b-4da4bc696f3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032328 Apr 20 16:24:14 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 135/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:24:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:24:15 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-ac9e2c7e-2e13-4481-809f-966aefe0b118 req-e1a37c6d-3b2b-4d26-9c41-fbcf47f24eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabd55bf-46c4-41be-942d-b6563f6b2778", "name": "network-vif-plugged", "status": "completed", "tag": "51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:24:15 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-ac9e2c7e-2e13-4481-809f-966aefe0b118 req-e1a37c6d-3b2b-4d26-9c41-fbcf47f24eb5 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:24:15 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-ac9e2c7e-2e13-4481-809f-966aefe0b118 req-e1a37c6d-3b2b-4d26-9c41-fbcf47f24eb5 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:24:15 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-ac9e2c7e-2e13-4481-809f-966aefe0b118 req-e1a37c6d-3b2b-4d26-9c41-fbcf47f24eb5 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:24:15 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-ac9e2c7e-2e13-4481-809f-966aefe0b118 req-e1a37c6d-3b2b-4d26-9c41-fbcf47f24eb5 service nova] Creating event network-vif-plugged:51a9dc4c-8c53-4b2d-b20e-aca8c3c70bff for instance cabd55bf-46c4-41be-942d-b6563f6b2778 on user Apr 20 16:24:15 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-ac9e2c7e-2e13-4481-809f-966aefe0b118 req-e1a37c6d-3b2b-4d26-9c41-fbcf47f24eb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030727 Apr 20 16:24:15 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 138/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:24:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] [instance: cabd55bf-46c4-41be-942d-b6563f6b2778] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:25:03 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] HTTP exception thrown: Instance cabd55bf-46c4-41be-942d-b6563f6b2778 could not be found. Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Request method failure captured: Apr 20 16:25:03 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778 HTTP/1.1 Apr 20 16:25:03 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:25:03 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:25:03 user devstack@n-api.service[61517]: Connection: close Apr 20 16:25:03 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:25:03 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:25:03 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:25:03 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:25:03 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWUvygav6XiGnd6jDhv3045ShMaaz0eFdLFWwQ-c7QolmQMrxH2kcMWHZeDgmEzhN08puzv-0GFUsUD9mab0wvEJmobVS6E9O153pFsl1fufzBmM11SkPKTrIfg59bUuiqJAzAi6fQRBvxGgkbCbMoE5kYkl4PN3RDfxKM7ofi6bll4 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Project-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f978ad5201e412894f30daa8e2bd2e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Tenant-Id: 8f978ad5201e412894f30daa8e2bd2e8 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:25:03 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:25:03 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:25:03 user devstack@n-api.service[61517]: X-User-Id: 8c79a05e12ae4aab91bc79d32b02ef46 Apr 20 16:25:03 user devstack@n-api.service[61517]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member Apr 20 16:25:03 user devstack@n-api.service[61517]: method: > Apr 20 16:25:03 user devstack@n-api.service[61517]: exception: Instance cabd55bf-46c4-41be-942d-b6563f6b2778 could not be found. Apr 20 16:25:03 user devstack@n-api.service[61517]: action_args: {'id': 'cabd55bf-46c4-41be-942d-b6563f6b2778'} Apr 20 16:25:03 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabd55bf-46c4-41be-942d-b6563f6b2778 could not be found. Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabd55bf-46c4-41be-942d-b6563f6b2778 could not be found. Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabd55bf-46c4-41be-942d-b6563f6b2778 could not be found. Apr 20 16:25:03 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:25:03 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] Returning 404 to user: Instance cabd55bf-46c4-41be-942d-b6563f6b2778 could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:25:03 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-235eb1a0-9dfa-4a90-90e7-6cbb72a58f3d tempest-ServerBootFromVolumeStableRescueTest-2108053043 tempest-ServerBootFromVolumeStableRescueTest-2108053043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778" status: 404 len: 111 microversion: 2.87 time: 0.039049 Apr 20 16:25:03 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 138/411] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 16:25:03 2023] GET /compute/v2.1/servers/cabd55bf-46c4-41be-942d-b6563f6b2778 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 16:25:42 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:42 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:42 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:25:42 user devstack@n-api.service[61518]: Thu Apr 20 16:25:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 20 16:25:42 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-33e4980c-623d-4e87-86a0-db16d8df13e2 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Action: 'create', calling method: .version_select at 0x7f558779f9a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-880855576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG80KFXisUW1wgnTLUsZOsmfwb0L2g+7zVWJHjlgBov1H5d5fA/SYjooY3obdw4LI3DgJUhFqtlNsqpLQfIe2UgxJvi7QEmnu2VryHUuLpN882Z/fgkNNzTXR8n7LE8gw=="}} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:25:42 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-33e4980c-623d-4e87-86a0-db16d8df13e2 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:25:42 user devstack@n-api.service[61518]: DEBUG nova.quota [None req-33e4980c-623d-4e87-86a0-db16d8df13e2 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for user f4ec42233fc040d0bef4f2e408a561b7 and project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'key_pairs'} {{(pid=61518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:25:42 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-33e4980c-623d-4e87-86a0-db16d8df13e2 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063959 Apr 20 16:25:42 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 136/412] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:25:42 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:25:42 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:42 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=8 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:42 user devstack@n-api.service[61519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:25:42 user devstack@n-api.service[61519]: Thu Apr 20 16:25:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:25:42 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1941398318", "imageRef": "831fa3c6-3f0e-4cb3-88a3-dda89b7ed63f", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-880855576", "networks": [{"uuid": "b19664d3-6727-47cf-81c3-ee6ea3992cb8"}]}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:25:42 user devstack@n-api.service[61519]: DEBUG nova.network.neutron [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] validate_networks() for [('b19664d3-6727-47cf-81c3-ee6ea3992cb8', None, None, None, None, None)] {{(pid=61519) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Flavor limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Image limits 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Flavor pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Image pref 0:0:0 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.virt.hardware [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for user f4ec42233fc040d0bef4f2e408a561b7 and project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'cores', 'instances', 'ram'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Going to run 1 instances... {{(pid=61519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:25:43 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='831fa3c6-3f0e-4cb3-88a3-dda89b7ed63f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:25:43 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-0c868f4b-07d0-41fe-9378-2e5b4bb92eea tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.725883 Apr 20 16:25:43 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 139/413] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:25:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:25:43 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-4da9cbf3-d5ef-45c6-88b8-bf0f6c18306d tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:25:43 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-4da9cbf3-d5ef-45c6-88b8-bf0f6c18306d tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:25:43 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:43 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:25:43 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-4da9cbf3-d5ef-45c6-88b8-bf0f6c18306d tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:25:43 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-4da9cbf3-d5ef-45c6-88b8-bf0f6c18306d tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d" status: 200 len: 1252 microversion: 2.1 time: 0.079221 Apr 20 16:25:43 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 139/414] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:25:43 2023] GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d => generated 1252 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:25:45 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-ccbac26c-e0f1-45c4-9bf6-3322ab1b8343 req-7f47381a-aa55-4e79-9a6d-2a471c92cd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3efdbb9-b302-44db-bba1-32181ad4e70d", "tag": "ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:25:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-ccbac26c-e0f1-45c4-9bf6-3322ab1b8343 req-7f47381a-aa55-4e79-9a6d-2a471c92cd80 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:25:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-ccbac26c-e0f1-45c4-9bf6-3322ab1b8343 req-7f47381a-aa55-4e79-9a6d-2a471c92cd80 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:25:45 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-ccbac26c-e0f1-45c4-9bf6-3322ab1b8343 req-7f47381a-aa55-4e79-9a6d-2a471c92cd80 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:25:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-ccbac26c-e0f1-45c4-9bf6-3322ab1b8343 req-7f47381a-aa55-4e79-9a6d-2a471c92cd80 service nova] Creating event network-changed:ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729 for instance b3efdbb9-b302-44db-bba1-32181ad4e70d on user Apr 20 16:25:45 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-ccbac26c-e0f1-45c4-9bf6-3322ab1b8343 req-7f47381a-aa55-4e79-9a6d-2a471c92cd80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034163 Apr 20 16:25:45 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 137/415] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:25:48 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-87f0602e-4131-4c50-b264-ff38cc496a96 req-6c284bc4-04a2-4640-816b-e2bc0b2a9207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3efdbb9-b302-44db-bba1-32181ad4e70d", "name": "network-vif-plugged", "status": "completed", "tag": "ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:25:48 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-87f0602e-4131-4c50-b264-ff38cc496a96 req-6c284bc4-04a2-4640-816b-e2bc0b2a9207 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:25:48 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-87f0602e-4131-4c50-b264-ff38cc496a96 req-6c284bc4-04a2-4640-816b-e2bc0b2a9207 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:25:48 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-87f0602e-4131-4c50-b264-ff38cc496a96 req-6c284bc4-04a2-4640-816b-e2bc0b2a9207 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:25:48 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-87f0602e-4131-4c50-b264-ff38cc496a96 req-6c284bc4-04a2-4640-816b-e2bc0b2a9207 service nova] Creating event network-vif-plugged:ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729 for instance b3efdbb9-b302-44db-bba1-32181ad4e70d on user Apr 20 16:25:48 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-87f0602e-4131-4c50-b264-ff38cc496a96 req-6c284bc4-04a2-4640-816b-e2bc0b2a9207 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045852 Apr 20 16:25:48 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 140/416] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:25:50 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-ceaaad21-4cfe-41ae-9050-cbf028867e6e req-c04b86ed-5030-4bd9-bfcd-47af749c1753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3efdbb9-b302-44db-bba1-32181ad4e70d", "name": "network-vif-plugged", "status": "completed", "tag": "ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:25:50 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ceaaad21-4cfe-41ae-9050-cbf028867e6e req-c04b86ed-5030-4bd9-bfcd-47af749c1753 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:25:50 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ceaaad21-4cfe-41ae-9050-cbf028867e6e req-c04b86ed-5030-4bd9-bfcd-47af749c1753 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:25:50 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ceaaad21-4cfe-41ae-9050-cbf028867e6e req-c04b86ed-5030-4bd9-bfcd-47af749c1753 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:25:50 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-ceaaad21-4cfe-41ae-9050-cbf028867e6e req-c04b86ed-5030-4bd9-bfcd-47af749c1753 service nova] Creating event network-vif-plugged:ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729 for instance b3efdbb9-b302-44db-bba1-32181ad4e70d on user Apr 20 16:25:50 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-ceaaad21-4cfe-41ae-9050-cbf028867e6e req-c04b86ed-5030-4bd9-bfcd-47af749c1753 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036280 Apr 20 16:25:50 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 140/417] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:25:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:26:33 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 16:26:33 user devstack@n-api.service[61518]: Thu Apr 20 16:26:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d (ip 10.0.0.210) !!! Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:26:33 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:26:33 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-ad8a2fd7-fb39-4e39-8aee-f630178f7d8b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d" status: 200 len: 1535 microversion: 2.1 time: 0.346503 Apr 20 16:26:33 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 138/418] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:26:33 2023] GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d => generated 1535 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:33 user devstack@n-api.service[61519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:27:33 user devstack@n-api.service[61519]: Thu Apr 20 16:27:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d (ip 10.0.0.210) !!! Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:33 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:34 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:27:34 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-bc50cecb-db8f-4423-b17e-d1ed01543751 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d" status: 200 len: 1535 microversion: 2.1 time: 0.308228 Apr 20 16:27:34 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 141/419] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:27:33 2023] GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d => generated 1535 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:34 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:27:34 user devstack@n-api.service[61517]: Thu Apr 20 16:27:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:27:34 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:27:34 user devstack@n-api.service[61517]: Thu Apr 20 16:27:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Searching by: {'deleted': False, 'project_id': '1558b18ec4304868ad6d8c61b5525d55'} {{(pid=61517) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:34 user devstack@n-api.service[61517]: DEBUG nova.compute.multi_cell_list [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 16:27:34 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-e133bad3-624a-493e-8781-e9a24c445dd0 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.216407 Apr 20 16:27:34 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 141/420] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 16:27:34 2023] GET /compute/v2.1/servers => generated 341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=6 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:34 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:27:34 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-20c434bb-15e8-4a98-a817-60d2f817121c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d" status: 200 len: 1535 microversion: 2.1 time: 0.228006 Apr 20 16:27:34 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 139/421] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:27:34 2023] GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d => generated 1535 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:36 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Going to try to terminate instance {{(pid=61519) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:27:36 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-0490de03-4392-4e4f-b580-c5e68c6230ae tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d" status: 204 len: 0 microversion: 2.1 time: 0.117173 Apr 20 16:27:36 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 142/422] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:27:36 2023] DELETE /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:36 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:27:36 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-b1780f98-33a6-43d4-8a77-f3cdfd932808 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d" status: 200 len: 1541 microversion: 2.1 time: 0.329990 Apr 20 16:27:36 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 142/423] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:27:36 2023] GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d => generated 1541 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:27:36 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-13b18a07-1109-451b-8c20-536203fbefa7 req-d8c5ab18-f055-42a8-a7f5-d47cdbb3a5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3efdbb9-b302-44db-bba1-32181ad4e70d", "name": "network-vif-unplugged", "status": "completed", "tag": "ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:27:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-13b18a07-1109-451b-8c20-536203fbefa7 req-d8c5ab18-f055-42a8-a7f5-d47cdbb3a5d1 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-13b18a07-1109-451b-8c20-536203fbefa7 req-d8c5ab18-f055-42a8-a7f5-d47cdbb3a5d1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:36 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-13b18a07-1109-451b-8c20-536203fbefa7 req-d8c5ab18-f055-42a8-a7f5-d47cdbb3a5d1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:36 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-13b18a07-1109-451b-8c20-536203fbefa7 req-d8c5ab18-f055-42a8-a7f5-d47cdbb3a5d1 service nova] Creating event network-vif-unplugged:ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729 for instance b3efdbb9-b302-44db-bba1-32181ad4e70d on user Apr 20 16:27:36 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-13b18a07-1109-451b-8c20-536203fbefa7 req-d8c5ab18-f055-42a8-a7f5-d47cdbb3a5d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088222 Apr 20 16:27:36 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 140/424] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:27:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:27:38 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-8b1b3f68-edaf-4d39-8423-b1263b5709a2 req-0304a67a-91e0-4fc7-be7a-99562813eb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3efdbb9-b302-44db-bba1-32181ad4e70d", "name": "network-vif-plugged", "status": "completed", "tag": "ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729"}, {"server_uuid": "b3efdbb9-b302-44db-bba1-32181ad4e70d", "name": "network-vif-deleted", "tag": "ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:27:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8b1b3f68-edaf-4d39-8423-b1263b5709a2 req-0304a67a-91e0-4fc7-be7a-99562813eb13 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:27:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8b1b3f68-edaf-4d39-8423-b1263b5709a2 req-0304a67a-91e0-4fc7-be7a-99562813eb13 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:27:38 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-8b1b3f68-edaf-4d39-8423-b1263b5709a2 req-0304a67a-91e0-4fc7-be7a-99562813eb13 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:27:38 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-8b1b3f68-edaf-4d39-8423-b1263b5709a2 req-0304a67a-91e0-4fc7-be7a-99562813eb13 service nova] Creating event network-vif-plugged:ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729 for instance b3efdbb9-b302-44db-bba1-32181ad4e70d on user Apr 20 16:27:38 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-8b1b3f68-edaf-4d39-8423-b1263b5709a2 req-0304a67a-91e0-4fc7-be7a-99562813eb13 service nova] Creating event network-vif-deleted:ccb48d0c-5b4b-4af7-b81b-a0eb20e0a729 for instance b3efdbb9-b302-44db-bba1-32181ad4e70d on user Apr 20 16:27:38 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-8b1b3f68-edaf-4d39-8423-b1263b5709a2 req-0304a67a-91e0-4fc7-be7a-99562813eb13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031148 Apr 20 16:27:38 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 143/425] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:27:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: b3efdbb9-b302-44db-bba1-32181ad4e70d] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=4 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=14 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:28:26 user devstack@n-api.service[61517]: INFO nova.api.openstack.wsgi [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] HTTP exception thrown: Instance b3efdbb9-b302-44db-bba1-32181ad4e70d could not be found. Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Request method failure captured: Apr 20 16:28:26 user devstack@n-api.service[61517]: request: GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d HTTP/1.1 Apr 20 16:28:26 user devstack@n-api.service[61517]: Accept: application/json Apr 20 16:28:26 user devstack@n-api.service[61517]: Accept-Encoding: identity Apr 20 16:28:26 user devstack@n-api.service[61517]: Connection: close Apr 20 16:28:26 user devstack@n-api.service[61517]: Content-Length: 0 Apr 20 16:28:26 user devstack@n-api.service[61517]: Content-Type: application/json Apr 20 16:28:26 user devstack@n-api.service[61517]: Host: 10.0.0.210 Apr 20 16:28:26 user devstack@n-api.service[61517]: Openstack-System-Scope: None Apr 20 16:28:26 user devstack@n-api.service[61517]: User-Agent: python-urllib3/1.26.15 Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Auth-Token: gAAAAABkQWd9B3dj8xZhzTKEtJuLB-7WIjJQYthKZpECTARusxwj0meIFJyF6Im9dJVsFIExmMZ32G_ZUh2NEA0FQA-5eK7ztorX3tHbVssMuqZ1Cak7zS6SY0-PQtQ-_dZ0Yi4skHydH7WDnxwPUb__jpzFVpOumbf9VNJI-XTnlt8zYvYaEJc Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Domain-Id: None Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Domain-Name: None Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Identity-Status: Confirmed Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Is-Admin-Project: True Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Project-Domain-Id: default Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Project-Domain-Name: Default Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Project-Id: 1558b18ec4304868ad6d8c61b5525d55 Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Project-Name: tempest-TestMinimumBasicScenario-1763718283 Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Role: reader,member Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Roles: reader,member Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1558b18ec4304868ad6d8c61b5525d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1558b18ec4304868ad6d8c61b5525d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1558b18ec4304868ad6d8c61b5525d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Tenant: tempest-TestMinimumBasicScenario-1763718283 Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Tenant-Id: 1558b18ec4304868ad6d8c61b5525d55 Apr 20 16:28:26 user devstack@n-api.service[61517]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1763718283 Apr 20 16:28:26 user devstack@n-api.service[61517]: X-User: tempest-TestMinimumBasicScenario-1763718283-project-member Apr 20 16:28:26 user devstack@n-api.service[61517]: X-User-Domain-Id: default Apr 20 16:28:26 user devstack@n-api.service[61517]: X-User-Domain-Name: Default Apr 20 16:28:26 user devstack@n-api.service[61517]: X-User-Id: f4ec42233fc040d0bef4f2e408a561b7 Apr 20 16:28:26 user devstack@n-api.service[61517]: X-User-Name: tempest-TestMinimumBasicScenario-1763718283-project-member Apr 20 16:28:26 user devstack@n-api.service[61517]: method: > Apr 20 16:28:26 user devstack@n-api.service[61517]: exception: Instance b3efdbb9-b302-44db-bba1-32181ad4e70d could not be found. Apr 20 16:28:26 user devstack@n-api.service[61517]: action_args: {'id': 'b3efdbb9-b302-44db-bba1-32181ad4e70d'} Apr 20 16:28:26 user devstack@n-api.service[61517]: {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3efdbb9-b302-44db-bba1-32181ad4e70d could not be found. Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3efdbb9-b302-44db-bba1-32181ad4e70d could not be found. Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3efdbb9-b302-44db-bba1-32181ad4e70d could not be found. Apr 20 16:28:26 user devstack@n-api.service[61517]: ERROR nova.api.openstack.wsgi Apr 20 16:28:26 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Returning 404 to user: Instance b3efdbb9-b302-44db-bba1-32181ad4e70d could not be found. {{(pid=61517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:28:26 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-ffc8ecec-5ab9-4c04-9420-f17382ade3af tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d" status: 404 len: 111 microversion: 2.1 time: 0.039500 Apr 20 16:28:26 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 143/426] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:28:26 2023] GET /compute/v2.1/servers/b3efdbb9-b302-44db-bba1-32181ad4e70d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:28:26 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:28:26 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=8 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:28:26 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-61285c33-b3f3-4594-93d5-481690ac3629 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '.version_select at 0x7f558779f400>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:28:26 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-61285c33-b3f3-4594-93d5-481690ac3629 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-880855576" status: 202 len: 0 microversion: 2.1 time: 0.031598 Apr 20 16:28:26 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 141/427] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 20 16:28:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-880855576 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 16:28:28 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:28:28 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:28:28 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-33287ad5-b4a2-4c84-8a1a-868168807ada tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Action: 'create', calling method: .version_select at 0x7f5587736ef0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2042608265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiZZWNvgI17HKNI+BXt+KB+YEhHbL07acsxespKHluya8pbshsGDbeReZUbLVLN3F7mDKtBiKIV6ZgsjnVVog16/FMqASI+9Nj8b/dyFgrEQl+sLNa7cvuPjZiurAj63Q=="}} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:28:28 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-33287ad5-b4a2-4c84-8a1a-868168807ada tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:28:28 user devstack@n-api.service[61519]: DEBUG nova.quota [None req-33287ad5-b4a2-4c84-8a1a-868168807ada tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for user f4ec42233fc040d0bef4f2e408a561b7 and project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'key_pairs'} {{(pid=61519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:28:28 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-33287ad5-b4a2-4c84-8a1a-868168807ada tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059137 Apr 20 16:28:28 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 144/428] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 16:28:28 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:28:28 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1486305246", "imageRef": "d41eddb3-3b65-456d-ab27-e42a9678ef7d", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2042608265", "networks": [{"uuid": "b19664d3-6727-47cf-81c3-ee6ea3992cb8"}]}} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:28:28 user devstack@n-api.service[61517]: DEBUG nova.network.neutron [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] validate_networks() for [('b19664d3-6727-47cf-81c3-ee6ea3992cb8', None, None, None, None, None)] {{(pid=61517) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Flavor limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Image limits 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Flavor pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Image pref 0:0:0 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.virt.hardware [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.quota [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Getting quotas for user f4ec42233fc040d0bef4f2e408a561b7 and project 1558b18ec4304868ad6d8c61b5525d55. Resources: {'cores', 'instances', 'ram'} {{(pid=61517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Going to run 1 instances... {{(pid=61517) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 16:28:29 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d41eddb3-3b65-456d-ab27-e42a9678ef7d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 16:28:29 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-a9604a8b-fab9-4af1-9d67-5182007b2b52 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.626592 Apr 20 16:28:29 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 144/429] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 16:28:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 16:28:29 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-4b0c05d6-d70e-4e54-9930-4cd8087eaaac tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:28:29 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-4b0c05d6-d70e-4e54-9930-4cd8087eaaac tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:28:29 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-4b0c05d6-d70e-4e54-9930-4cd8087eaaac tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:28:29 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-4b0c05d6-d70e-4e54-9930-4cd8087eaaac tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71" status: 200 len: 1253 microversion: 2.1 time: 0.075133 Apr 20 16:28:29 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 142/430] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:28:29 2023] GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 => generated 1253 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:28:32 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-36d66d27-749b-4aef-894f-9bdf1bfa1803 req-85cc62c8-548c-42e8-a5eb-39a87bc779c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4e2b86-7582-425a-9f8c-15e7bbaefb71", "tag": "69123f68-1692-4e10-9cee-e15040c7638f"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:28:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-36d66d27-749b-4aef-894f-9bdf1bfa1803 req-85cc62c8-548c-42e8-a5eb-39a87bc779c7 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:28:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-36d66d27-749b-4aef-894f-9bdf1bfa1803 req-85cc62c8-548c-42e8-a5eb-39a87bc779c7 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:28:32 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-36d66d27-749b-4aef-894f-9bdf1bfa1803 req-85cc62c8-548c-42e8-a5eb-39a87bc779c7 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:28:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-36d66d27-749b-4aef-894f-9bdf1bfa1803 req-85cc62c8-548c-42e8-a5eb-39a87bc779c7 service nova] Creating event network-changed:69123f68-1692-4e10-9cee-e15040c7638f for instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 on user Apr 20 16:28:32 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-36d66d27-749b-4aef-894f-9bdf1bfa1803 req-85cc62c8-548c-42e8-a5eb-39a87bc779c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031178 Apr 20 16:28:32 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 145/431] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:28:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:28:34 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4e2b86-7582-425a-9f8c-15e7bbaefb71", "name": "network-vif-plugged", "status": "completed", "tag": "69123f68-1692-4e10-9cee-e15040c7638f"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:28:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:28:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:28:34 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:28:34 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] Creating event network-vif-plugged:69123f68-1692-4e10-9cee-e15040c7638f for instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 on user Apr 20 16:28:34 user devstack@n-api.service[61517]: ERROR oslo.messaging._drivers.impl_rabbit [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] [543175a7-24c6-4fab-abb4-c54890e9157e] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 16:28:35 user devstack@n-api.service[61517]: INFO oslo.messaging._drivers.impl_rabbit [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] [543175a7-24c6-4fab-abb4-c54890e9157e] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38374. Apr 20 16:28:35 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-ea2dade3-cb74-40db-945a-1f2b2578fe6a req-e5761fc0-19aa-440d-91b0-99243c6278f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.044465 Apr 20 16:28:35 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 145/432] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:28:37 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [req-b97759b7-2b8a-44a4-a30f-a1653e1c1911 req-a0d2aefd-4ce9-46b6-8d2f-0fa49e024e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4e2b86-7582-425a-9f8c-15e7bbaefb71", "name": "network-vif-plugged", "status": "completed", "tag": "69123f68-1692-4e10-9cee-e15040c7638f"}]} {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:28:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-b97759b7-2b8a-44a4-a30f-a1653e1c1911 req-a0d2aefd-4ce9-46b6-8d2f-0fa49e024e0f service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:28:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-b97759b7-2b8a-44a4-a30f-a1653e1c1911 req-a0d2aefd-4ce9-46b6-8d2f-0fa49e024e0f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:28:37 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [req-b97759b7-2b8a-44a4-a30f-a1653e1c1911 req-a0d2aefd-4ce9-46b6-8d2f-0fa49e024e0f service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:28:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.compute.server_external_events [req-b97759b7-2b8a-44a4-a30f-a1653e1c1911 req-a0d2aefd-4ce9-46b6-8d2f-0fa49e024e0f service nova] Creating event network-vif-plugged:69123f68-1692-4e10-9cee-e15040c7638f for instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 on user Apr 20 16:28:37 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [req-b97759b7-2b8a-44a4-a30f-a1653e1c1911 req-a0d2aefd-4ce9-46b6-8d2f-0fa49e024e0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036764 Apr 20 16:28:37 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 143/433] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell0:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:29:19 user devstack@n-api.service[61519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:29:19 user devstack@n-api.service[61519]: Thu Apr 20 16:29:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 (ip 10.0.0.210) !!! Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:29:19 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:29:19 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-e0f49b70-0e55-4de1-bc79-dd74a5b9f5e7 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71" status: 200 len: 1536 microversion: 2.1 time: 0.285383 Apr 20 16:29:19 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 146/434] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:29:19 2023] GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 => generated 1536 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=2 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell0:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG dbcounter [-] [61517] Writing DB stats nova_cell1:SELECT=6 {{(pid=61517) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:20 user devstack@n-api.service[61517]: DEBUG nova.policy [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61517) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:30:20 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-47d91554-712a-4c9d-8937-dea989ad439b tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71" status: 200 len: 1536 microversion: 2.1 time: 0.235464 Apr 20 16:30:20 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 146/435] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:30:20 2023] GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 => generated 1536 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 16:30:20 user devstack@n-api.service[61518]: Thu Apr 20 16:30:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Searching by: {'deleted': False, 'project_id': '1558b18ec4304868ad6d8c61b5525d55'} {{(pid=61518) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:20 user devstack@n-api.service[61518]: DEBUG nova.compute.multi_cell_list [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 16:30:20 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-5dfb815a-b8f1-4967-8c41-8b6bf8b61351 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.205704 Apr 20 16:30:20 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 144/436] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 16:30:20 2023] GET /compute/v2.1/servers => generated 341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=2 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=6 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:20 user devstack@n-api.service[61519]: DEBUG nova.policy [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61519) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:30:20 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-96341156-3c62-4113-bf27-8296f915eb37 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71" status: 200 len: 1536 microversion: 2.1 time: 0.170079 Apr 20 16:30:20 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 147/437] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:30:20 2023] GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 => generated 1536 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Fetching instance by UUID {{(pid=61517) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:22 user devstack@n-api.service[61517]: DEBUG nova.compute.api [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Going to try to terminate instance {{(pid=61517) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 16:30:22 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [None req-14297b38-c7a8-48e6-940e-ca121ff91c5c tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71" status: 204 len: 0 microversion: 2.1 time: 0.119334 Apr 20 16:30:22 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 147/438] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 16:30:22 2023] DELETE /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG nova.compute.api [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Fetching instance by UUID {{(pid=61518) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG oslo_concurrency.lockutils [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61518) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:22 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [req-df14bdc4-4d05-4e05-8a24-ab9f3524673f req-d8485864-2cb9-416f-9ffe-e500b88376ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4e2b86-7582-425a-9f8c-15e7bbaefb71", "name": "network-vif-unplugged", "status": "completed", "tag": "69123f68-1692-4e10-9cee-e15040c7638f"}]} {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:30:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-df14bdc4-4d05-4e05-8a24-ab9f3524673f req-d8485864-2cb9-416f-9ffe-e500b88376ff service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-df14bdc4-4d05-4e05-8a24-ab9f3524673f req-d8485864-2cb9-416f-9ffe-e500b88376ff service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:22 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [req-df14bdc4-4d05-4e05-8a24-ab9f3524673f req-d8485864-2cb9-416f-9ffe-e500b88376ff service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:22 user devstack@n-api.service[61519]: INFO nova.api.openstack.compute.server_external_events [req-df14bdc4-4d05-4e05-8a24-ab9f3524673f req-d8485864-2cb9-416f-9ffe-e500b88376ff service nova] Creating event network-vif-unplugged:69123f68-1692-4e10-9cee-e15040c7638f for instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 on user Apr 20 16:30:22 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [req-df14bdc4-4d05-4e05-8a24-ab9f3524673f req-d8485864-2cb9-416f-9ffe-e500b88376ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029846 Apr 20 16:30:22 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 148/439] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:30:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:30:22 user devstack@n-api.service[61518]: DEBUG nova.policy [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ec42233fc040d0bef4f2e408a561b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558b18ec4304868ad6d8c61b5525d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61518) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 16:30:22 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-d893dbeb-e329-436b-b501-2414bc7b2005 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71" status: 200 len: 1542 microversion: 2.1 time: 0.360458 Apr 20 16:30:22 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 145/440] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:30:22 2023] GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 => generated 1542 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 16:30:24 user devstack@n-api.service[61517]: DEBUG nova.api.openstack.wsgi [req-eed132f4-8e8b-41de-aca7-a1b3f0569f7e req-862bfdbe-ad94-4be5-a95e-8fb82d370d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4e2b86-7582-425a-9f8c-15e7bbaefb71", "name": "network-vif-plugged", "status": "completed", "tag": "69123f68-1692-4e10-9cee-e15040c7638f"}, {"server_uuid": "2c4e2b86-7582-425a-9f8c-15e7bbaefb71", "name": "network-vif-deleted", "tag": "69123f68-1692-4e10-9cee-e15040c7638f"}]} {{(pid=61517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 16:30:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-eed132f4-8e8b-41de-aca7-a1b3f0569f7e req-862bfdbe-ad94-4be5-a95e-8fb82d370d69 service nova] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:30:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-eed132f4-8e8b-41de-aca7-a1b3f0569f7e req-862bfdbe-ad94-4be5-a95e-8fb82d370d69 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:30:24 user devstack@n-api.service[61517]: DEBUG oslo_concurrency.lockutils [req-eed132f4-8e8b-41de-aca7-a1b3f0569f7e req-862bfdbe-ad94-4be5-a95e-8fb82d370d69 service nova] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61517) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:30:24 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-eed132f4-8e8b-41de-aca7-a1b3f0569f7e req-862bfdbe-ad94-4be5-a95e-8fb82d370d69 service nova] Creating event network-vif-plugged:69123f68-1692-4e10-9cee-e15040c7638f for instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 on user Apr 20 16:30:24 user devstack@n-api.service[61517]: INFO nova.api.openstack.compute.server_external_events [req-eed132f4-8e8b-41de-aca7-a1b3f0569f7e req-862bfdbe-ad94-4be5-a95e-8fb82d370d69 service nova] Creating event network-vif-deleted:69123f68-1692-4e10-9cee-e15040c7638f for instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 on user Apr 20 16:30:24 user devstack@n-api.service[61517]: INFO nova.api.openstack.requestlog [req-eed132f4-8e8b-41de-aca7-a1b3f0569f7e req-862bfdbe-ad94-4be5-a95e-8fb82d370d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029893 Apr 20 16:30:24 user devstack@n-api.service[61517]: [pid: 61517|app: 0|req: 148/441] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 16:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_api:SELECT=4 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG dbcounter [-] [61519] Writing DB stats nova_cell1:SELECT=8 {{(pid=61519) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '>' {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG nova.compute.api [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [instance: 2c4e2b86-7582-425a-9f8c-15e7bbaefb71] Fetching instance by UUID {{(pid=61519) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Acquiring lock "c920c466-c336-4d65-b6e3-87fa61d5f331" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG oslo_concurrency.lockutils [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Lock "c920c466-c336-4d65-b6e3-87fa61d5f331" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61519) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 16:31:12 user devstack@n-api.service[61519]: INFO nova.api.openstack.wsgi [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] HTTP exception thrown: Instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 could not be found. Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Request method failure captured: Apr 20 16:31:12 user devstack@n-api.service[61519]: request: GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 HTTP/1.1 Apr 20 16:31:12 user devstack@n-api.service[61519]: Accept: application/json Apr 20 16:31:12 user devstack@n-api.service[61519]: Accept-Encoding: identity Apr 20 16:31:12 user devstack@n-api.service[61519]: Connection: close Apr 20 16:31:12 user devstack@n-api.service[61519]: Content-Length: 0 Apr 20 16:31:12 user devstack@n-api.service[61519]: Content-Type: application/json Apr 20 16:31:12 user devstack@n-api.service[61519]: Host: 10.0.0.210 Apr 20 16:31:12 user devstack@n-api.service[61519]: Openstack-System-Scope: None Apr 20 16:31:12 user devstack@n-api.service[61519]: User-Agent: python-urllib3/1.26.15 Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Auth-Token: gAAAAABkQWd9B3dj8xZhzTKEtJuLB-7WIjJQYthKZpECTARusxwj0meIFJyF6Im9dJVsFIExmMZ32G_ZUh2NEA0FQA-5eK7ztorX3tHbVssMuqZ1Cak7zS6SY0-PQtQ-_dZ0Yi4skHydH7WDnxwPUb__jpzFVpOumbf9VNJI-XTnlt8zYvYaEJc Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Domain-Id: None Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Domain-Name: None Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Identity-Status: Confirmed Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Is-Admin-Project: True Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Project-Domain-Id: default Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Project-Domain-Name: Default Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Project-Id: 1558b18ec4304868ad6d8c61b5525d55 Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Project-Name: tempest-TestMinimumBasicScenario-1763718283 Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Role: reader,member Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Roles: reader,member Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1558b18ec4304868ad6d8c61b5525d55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1558b18ec4304868ad6d8c61b5525d55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1558b18ec4304868ad6d8c61b5525d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Tenant: tempest-TestMinimumBasicScenario-1763718283 Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Tenant-Id: 1558b18ec4304868ad6d8c61b5525d55 Apr 20 16:31:12 user devstack@n-api.service[61519]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1763718283 Apr 20 16:31:12 user devstack@n-api.service[61519]: X-User: tempest-TestMinimumBasicScenario-1763718283-project-member Apr 20 16:31:12 user devstack@n-api.service[61519]: X-User-Domain-Id: default Apr 20 16:31:12 user devstack@n-api.service[61519]: X-User-Domain-Name: Default Apr 20 16:31:12 user devstack@n-api.service[61519]: X-User-Id: f4ec42233fc040d0bef4f2e408a561b7 Apr 20 16:31:12 user devstack@n-api.service[61519]: X-User-Name: tempest-TestMinimumBasicScenario-1763718283-project-member Apr 20 16:31:12 user devstack@n-api.service[61519]: method: > Apr 20 16:31:12 user devstack@n-api.service[61519]: exception: Instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 could not be found. Apr 20 16:31:12 user devstack@n-api.service[61519]: action_args: {'id': '2c4e2b86-7582-425a-9f8c-15e7bbaefb71'} Apr 20 16:31:12 user devstack@n-api.service[61519]: {{(pid=61519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 could not be found. Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 could not be found. Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 could not be found. Apr 20 16:31:12 user devstack@n-api.service[61519]: ERROR nova.api.openstack.wsgi Apr 20 16:31:12 user devstack@n-api.service[61519]: DEBUG nova.api.openstack.wsgi [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Returning 404 to user: Instance 2c4e2b86-7582-425a-9f8c-15e7bbaefb71 could not be found. {{(pid=61519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 16:31:12 user devstack@n-api.service[61519]: INFO nova.api.openstack.requestlog [None req-de9d0bc6-d63d-4e62-a3a5-339a95580146 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71" status: 404 len: 111 microversion: 2.1 time: 0.099079 Apr 20 16:31:12 user devstack@n-api.service[61519]: [pid: 61519|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 16:31:12 2023] GET /compute/v2.1/servers/2c4e2b86-7582-425a-9f8c-15e7bbaefb71 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 16:31:12 user devstack@n-api.service[61518]: DEBUG nova.api.openstack.wsgi [None req-ce330f98-9d66-4ddc-80b7-e08b7df7dc94 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] Calling method '.version_select at 0x7f558779f910>' {{(pid=61518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 16:31:12 user devstack@n-api.service[61518]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce330f98-9d66-4ddc-80b7-e08b7df7dc94 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [ce4892e0-77be-44fc-8d41-1f3231dfd8df] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 16:31:12 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell0:SELECT=2 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:31:12 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_api:SELECT=4 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:31:12 user devstack@n-api.service[61518]: DEBUG dbcounter [-] [61518] Writing DB stats nova_cell1:SELECT=14 {{(pid=61518) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 16:31:13 user devstack@n-api.service[61518]: INFO oslo.messaging._drivers.impl_rabbit [None req-ce330f98-9d66-4ddc-80b7-e08b7df7dc94 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] [ce4892e0-77be-44fc-8d41-1f3231dfd8df] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 46606. Apr 20 16:31:13 user devstack@n-api.service[61518]: INFO nova.api.openstack.requestlog [None req-ce330f98-9d66-4ddc-80b7-e08b7df7dc94 tempest-TestMinimumBasicScenario-1763718283 tempest-TestMinimumBasicScenario-1763718283-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2042608265" status: 202 len: 0 microversion: 2.1 time: 1.046017 Apr 20 16:31:13 user devstack@n-api.service[61518]: [pid: 61518|app: 0|req: 146/443] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 16:31:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2042608265 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)